-- Logs begin at Wed 2022-10-12 11:47:59 UTC, end at Wed 2022-10-12 12:46:03 UTC. -- Oct 12 12:15:09.569544 dv-cinder-812685-16-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 12:15:09.577099 dv-cinder-812685-16-smb devstack@keystone.service[81381]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 12:15:09.579101 dv-cinder-812685-16-smb devstack@keystone.service[81381]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 12:15:09 2022] *** Oct 12 12:15:09.579101 dv-cinder-812685-16-smb devstack@keystone.service[81381]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 12:15:09.579101 dv-cinder-812685-16-smb devstack@keystone.service[81381]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 12:15:09.579101 dv-cinder-812685-16-smb devstack@keystone.service[81381]: nodename: dv-cinder-812685-16-smb Oct 12 12:15:09.579101 dv-cinder-812685-16-smb devstack@keystone.service[81381]: machine: x86_64 Oct 12 12:15:09.579101 dv-cinder-812685-16-smb devstack@keystone.service[81381]: clock source: unix Oct 12 12:15:09.579101 dv-cinder-812685-16-smb devstack@keystone.service[81381]: pcre jit disabled Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: detected number of CPU cores: 4 Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: current working directory: / Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: detected binary path: /usr/bin/uwsgi-core Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: your processes number limit is 47680 Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: your memory page size is 4096 bytes Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: detected max file descriptor number: 2048 Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: lock engine: pthread robust mutexes Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: thunder lock: enabled Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 12:15:09.579548 dv-cinder-812685-16-smb devstack@keystone.service[81381]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 12:15:09.620233 dv-cinder-812685-16-smb devstack@keystone.service[81381]: Python main interpreter initialized at 0x55f4d92f99c0 Oct 12 12:15:09.620233 dv-cinder-812685-16-smb devstack@keystone.service[81381]: python threads support enabled Oct 12 12:15:09.620233 dv-cinder-812685-16-smb devstack@keystone.service[81381]: your server socket listen backlog is limited to 100 connections Oct 12 12:15:09.620233 dv-cinder-812685-16-smb devstack@keystone.service[81381]: your mercy for graceful operations on workers is 90 seconds Oct 12 12:15:09.620604 dv-cinder-812685-16-smb devstack@keystone.service[81381]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 12:15:09.620683 dv-cinder-812685-16-smb devstack@keystone.service[81381]: *** Operational MODE: preforking *** Oct 12 12:15:09.620964 dv-cinder-812685-16-smb devstack@keystone.service[81381]: *** uWSGI is running in multiple interpreter mode *** Oct 12 12:15:09.620964 dv-cinder-812685-16-smb devstack@keystone.service[81381]: spawned uWSGI master process (pid: 81381) Oct 12 12:15:09.621172 dv-cinder-812685-16-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 12 12:15:09.622884 dv-cinder-812685-16-smb devstack@keystone.service[81381]: spawned uWSGI worker 1 (pid: 81395, cores: 1) Oct 12 12:15:09.622884 dv-cinder-812685-16-smb devstack@keystone.service[81381]: spawned uWSGI worker 2 (pid: 81396, cores: 1) Oct 12 12:15:09.622884 dv-cinder-812685-16-smb devstack@keystone.service[81381]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 12:15:13.875092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:15:13.875092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: from cryptography.utils import int_from_bytes Oct 12 12:15:13.875859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:15:13.875859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: from cryptography.utils import int_from_bytes Oct 12 12:15:13.880987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:15:13.880987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: from cryptography.utils import int_from_bytes Oct 12 12:15:13.881454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:15:13.881454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: from cryptography.utils import int_from_bytes Oct 12 12:15:13.925542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:15:13.925740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:15:13.925935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] command line args: [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:15:13.926206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:15:13.926385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ================================================================================ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:15:13.926640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] admin_token = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.926892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] config_dir = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.927093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.927264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] config_source = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.927446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] debug = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.927647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.928877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.928877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.928877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.928877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.928877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.929138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] log_config_append = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.929201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:15:13.929270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.929331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:15:13.929395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] log_dir = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.929491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] command line args: [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:15:13.929622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] log_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.929768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:15:13.929878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.929948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ================================================================================ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:15:13.930014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] admin_token = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_dir = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.930914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_source = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] debug = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.931971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_config_append = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.932921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_dir = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] publish_errors = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.933998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.934844 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] standard_threads = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] use_journal = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.935971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.936055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] use_json = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.936193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] use_stderr = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.936276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.936361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] use_syslog = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.936485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.936589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.936847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.936983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.937089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.937167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] publish_errors = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.937351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.937474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.937585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.937761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.937761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.937979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.938090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.938207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.938318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.938436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.938554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] standard_threads = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.938665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.938781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.938892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.939002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.939120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.939234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.939404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.939516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_journal = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.939516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_json = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.939729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.939870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_stderr = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.939990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.940102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_syslog = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.940217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.940335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:15:13.940452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.940574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.940685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.940802 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.940916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.941941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.942974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.943085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.943195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.943480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.943611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.943725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.943850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.943970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.944909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.945932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.946047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.946170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.946287 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.946645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.946762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.946872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.946982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947212 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.947917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.948924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.949909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950590 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.950926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.951909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.952934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.953963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.954979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.955911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.956939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.957958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958075 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.958982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.959946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.960946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.961856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.external = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.962971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.password = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.token = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.963937 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.964983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965319 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.external = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.965898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.password = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.token = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.966901 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967362 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.967967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968656 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.968886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969580 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.969933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.970964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.971077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.971190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.971302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.971413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.971531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.971652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.972263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.972379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.972492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.972492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.972702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.972827 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.972942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.973985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974713 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.974946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.975981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.976895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.977947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978287 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.978969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.979963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.980994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981678 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.981912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982818 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.982931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.983977 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.984895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.985920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.986944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.987056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.987168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.987289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988844 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.988957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.989995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.990907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.991989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992228 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.992912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.993942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.994970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] role.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995653 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] role.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.995895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996136 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.996894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.997927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.998957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:13.999920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.000978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.001902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.002894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003161 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.003921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.004998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.005953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.006959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007766 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.007936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.008964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.009974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010088 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.010896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.011962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012540 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012653 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:15:14.012766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.012984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.013123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.013367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.013611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.013863 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.014107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.014359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.014602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.014856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.015100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.015351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.015588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.015860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.016105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:15:14.016279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:15:14.041674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.041854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.042081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.044821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.045058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.045288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.050962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.054132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.079069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.079300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.080060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.080300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.133631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.133769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.183136 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.183314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.183401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.183555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.343909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.344005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.344081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.344198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.344327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.367748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.368960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.369043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.369176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.369259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.369390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.380279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.380498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.392986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.393146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.393232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.393384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.393467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.394885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.395019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:15:14.412190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.412386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:15:14.412642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.412725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.412855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:15:14.412936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:15:14.413181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.413265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.413386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:15:14.413467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.413663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.413753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.413929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.414009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.414194 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.414455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.423579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.423897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.424057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.424177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.424339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.424468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.424612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.424920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.431472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.431898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.434414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.434701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.434785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.434990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.435070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.435278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.435359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.435569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.435652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.435861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.435945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.436142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.436235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.436423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.436502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.436697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.436776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.436969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.437050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.437242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.437322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.437513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.460707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.460874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.462186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.462341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.462476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.462634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.467159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.467294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.467447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.467581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.467732 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.467890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.474696 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.474788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.474989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.475070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.480603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.480707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.480896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.480976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.481183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.481265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.481470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.481551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.481749 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.481829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.482025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.482113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.482297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.482377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.482568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.482648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.498038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.498143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.498317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.498398 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.502211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.502294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.505472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.505565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.505772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.505853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.509990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.510085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.513125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.513252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.516457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.516545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.516758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.516840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.517985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.534169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.534288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.535010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.535102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.535280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.535361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.535545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.535627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.542409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.542493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.543981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.544164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.545514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.545601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.545792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.545874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.548489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.548585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.548776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.548858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.549059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.549141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.549353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.549434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.549745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.549834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.560877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.560979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.561164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.561245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.561449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.561541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.561733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.561814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.562117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.562199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.562407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.562496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.562698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.562778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.578310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.578416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.581765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.581859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.584688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.584777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.586123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.586218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.587683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.587764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.587993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.588076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.588400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.588531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.594815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.594907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.596257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.596342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.599697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.599785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.600122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.600204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.600413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.600503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.600697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.600777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.608487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.608583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.608776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.608871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.609059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.609144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.615938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.616031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:15:14.616223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.616307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.616507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.616589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.616798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.616879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.617997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.618192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.618281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.618481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.618561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.618760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.618840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.619025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.619108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.619291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.619370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.619558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.619637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:15:14.654344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f4d92f99c0 pid: 81395 (default app) Oct 12 12:15:14.654488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f4d92f99c0 pid: 81396 (default app) Oct 12 12:15:14.657606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e9246-16d9-415e-bd17-23808cc73847 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:14.657898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e9246-16d9-415e-bd17-23808cc73847 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:14.658172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e9246-16d9-415e-bd17-23808cc73847 None None] PATH_INFO: `/v3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:14.662425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Wed Oct 12 12:15:14 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:21.345219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524eaf4-9f62-4268-a013-f94a0a442fa5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:21.345723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524eaf4-9f62-4268-a013-f94a0a442fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:21.345829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524eaf4-9f62-4268-a013-f94a0a442fa5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:21.350581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:21.356073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:21.356638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:21.356638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:21.426562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: INFO dbcounter [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] Registered counter for database keystone Oct 12 12:15:21.445184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG oslo_db.sqlalchemy.engines [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:15:21.451679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writer thread running {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:15:21.630422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG passlib.handlers.bcrypt [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81395) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 12:15:21.630737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG passlib.handlers.bcrypt [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81395) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 12:15:21.689145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:21.690758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:21.816792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 12:15:22.287713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524eaf4-9f62-4268-a013-f94a0a442fa5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:22.357239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: INFO dbcounter [None req-f524eaf4-9f62-4268-a013-f94a0a442fa5 None None] Registered counter for database keystone Oct 12 12:15:22.378487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG oslo_db.sqlalchemy.engines [None req-f524eaf4-9f62-4268-a013-f94a0a442fa5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:15:22.384709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writer thread running {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:15:22.501858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524eaf4-9f62-4268-a013-f94a0a442fa5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:22.506106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3c2b-487b-4a72-8c6e-f9b94d523e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:22.506737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3c2b-487b-4a72-8c6e-f9b94d523e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:22.507015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3c2b-487b-4a72-8c6e-f9b94d523e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:22.507286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3c2b-487b-4a72-8c6e-f9b94d523e15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:22.515594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3c2b-487b-4a72-8c6e-f9b94d523e15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:22.566888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING keystone.common.rbac_enforcer.enforcer [None req-86bc3c2b-487b-4a72-8c6e-f9b94d523e15 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 12:15:22.567231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3c2b-487b-4a72-8c6e-f9b94d523e15 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:22.576777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Oct 12 12:15:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:15:22.583139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:22.600237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db262d-cfcc-45eb-a22c-f2dfb0f98839 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:22.604678 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f87e-8594-49ed-bfa7-1b11ba945ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:22.605778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f87e-8594-49ed-bfa7-1b11ba945ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:22.606066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f87e-8594-49ed-bfa7-1b11ba945ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:22.606336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f87e-8594-49ed-bfa7-1b11ba945ce2 admin admin] PATH_INFO: `/v3/projects/3f11c6a9324b4777879eb5cf98ff4596` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:22.607967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9f87e-8594-49ed-bfa7-1b11ba945ce2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f11c6a9324b4777879eb5cf98ff4596)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:22.660436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c4b9f87e-8594-49ed-bfa7-1b11ba945ce2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 12:15:22.660782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9f87e-8594-49ed-bfa7-1b11ba945ce2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:22.665299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 12 12:15:22 2022] GET /identity/v3/projects/3f11c6a9324b4777879eb5cf98ff4596 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:24.776421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64e51b-90b5-4099-af2d-86e5ef9c7b1f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:24.776837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64e51b-90b5-4099-af2d-86e5ef9c7b1f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:24.776971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64e51b-90b5-4099-af2d-86e5ef9c7b1f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:24.781112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:24.786593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deac07b-7f99-4eaf-a9c1-9e61b3ebc808 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:24.786973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deac07b-7f99-4eaf-a9c1-9e61b3ebc808 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:24.787149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deac07b-7f99-4eaf-a9c1-9e61b3ebc808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:24.807281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7deac07b-7f99-4eaf-a9c1-9e61b3ebc808 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:24.808824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7deac07b-7f99-4eaf-a9c1-9e61b3ebc808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:24.817147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:15:25.086206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64e51b-90b5-4099-af2d-86e5ef9c7b1f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:25.098623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64e51b-90b5-4099-af2d-86e5ef9c7b1f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:25.102755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6374def-0dda-49aa-b29e-237ef55c43ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:25.103343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374def-0dda-49aa-b29e-237ef55c43ba admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:25.103623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374def-0dda-49aa-b29e-237ef55c43ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:25.103937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374def-0dda-49aa-b29e-237ef55c43ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:25.111386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6374def-0dda-49aa-b29e-237ef55c43ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:25.113764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6374def-0dda-49aa-b29e-237ef55c43ba admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:25.122349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Oct 12 12:15:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:15:25.127482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deac07b-7f99-4eaf-a9c1-9e61b3ebc808 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:25.136418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deac07b-7f99-4eaf-a9c1-9e61b3ebc808 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:25.140691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8ff4f-965e-48a8-94e1-b996f450bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:25.141312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8ff4f-965e-48a8-94e1-b996f450bb28 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:25.141595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8ff4f-965e-48a8-94e1-b996f450bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:25.141871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8ff4f-965e-48a8-94e1-b996f450bb28 admin admin] PATH_INFO: `/v3/users/733666fc411e4b24a7cb942e8e901594` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:25.143159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8ff4f-965e-48a8-94e1-b996f450bb28 admin admin] RBAC: Authorizing `identity:get_user(user_id=733666fc411e4b24a7cb942e8e901594)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:25.145029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8ff4f-965e-48a8-94e1-b996f450bb28 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:25.146546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Wed Oct 12 12:15:25 2022] GET /identity/v3/users/733666fc411e4b24a7cb942e8e901594 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:27.304511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721d0a-489e-4a73-a0e9-00f667e83845 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:27.305039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721d0a-489e-4a73-a0e9-00f667e83845 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:27.305039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721d0a-489e-4a73-a0e9-00f667e83845 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:27.306539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:15:27.311324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6118a-d270-42d6-b984-b9c034565bda None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:27.311710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6118a-d270-42d6-b984-b9c034565bda None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:27.312024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6118a-d270-42d6-b984-b9c034565bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:27.329955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cba6118a-d270-42d6-b984-b9c034565bda None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:27.331135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cba6118a-d270-42d6-b984-b9c034565bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:27.376341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbd63-93f3-4ce7-8e54-30e878d513b5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:27.376626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbd63-93f3-4ce7-8e54-30e878d513b5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:27.376905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbd63-93f3-4ce7-8e54-30e878d513b5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:27.378214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:15:27.383927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:27.384292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:27.384578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:27.411718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:27.426847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG passlib.handlers.bcrypt [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81396) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 12:15:27.427239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG passlib.handlers.bcrypt [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81396) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 12:15:27.476652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:27.478200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:27.575815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:27.676986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6118a-d270-42d6-b984-b9c034565bda None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:27.702684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:27.782429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6118a-d270-42d6-b984-b9c034565bda None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:27.815251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:27.815919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:27.816206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:27.817020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:27.828374 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:27.837166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:27.838191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:27.839028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:27.840726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:27.845812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:27.926254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:27.942706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6715a-d8c9-4d6a-9645-84e7d8b2d9de None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:27.944693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfc96-2e91-47fe-8136-d84dd4a7f89d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:27.945011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:27.977613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:27.978209 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:27.978489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:27.978766 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:27.979419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:27.979718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:27.979827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:27.980715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:27.981004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:27.981130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:27.981284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:27.982265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:27.983896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:27.993126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:27.997094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.sql.core [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:15:27.997094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:15:27.997094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [parameters: {'id': '42502788e22542b5b47525b0962b96cd', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:15:27.997094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:15:27.998916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:15:28.016258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 12:15:28.017273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application yield resource Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise self.value Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application session.commit() Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:15:28.018613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:15:28.019660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:15:28.021460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:15:28.022579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [parameters: {'id': '42502788e22542b5b47525b0962b96cd', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 12:15:28.023733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:28.024672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 8/16] 10.222.0.45 () {60 vars in 1137 bytes} [Wed Oct 12 12:15:27 2022] POST /identity/v3/domains => generated 190 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:28.025770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:28.105539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87b54-6bc5-469b-bca9-1d5d2106602a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:28.119593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a523349-6532-4c4e-a6e7-9882252d034e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:28.138376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:28.139003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:28.139284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:28.139558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] PATH_INFO: `/v3/users/733666fc411e4b24a7cb942e8e901594` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:28.140728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=733666fc411e4b24a7cb942e8e901594)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:28.142174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:28.143734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:27 2022] GET /identity/v3/users/733666fc411e4b24a7cb942e8e901594 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:28.149592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:28.151509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:28.152418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:28.153386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:28.153386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:28.164111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:28.171903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:28.173400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:15:28.190326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:28.191203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:15:28.192100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:15:28.192100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:15:28.192100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:28.192100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:28.197185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:28.218387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:28.251312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b6bf-5384-4ca0-b113-6618f4d29eb4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:28.284044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:28.284675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:28.284958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:28.285792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:28.286913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:28.288397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:28.289947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:28.294789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de57e0-ff95-45cb-bef5-1ecd11f2f41a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:28.295600 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:28.328669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b604e-a92e-4a3e-8961-9b00990e16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:28.329276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b604e-a92e-4a3e-8961-9b00990e16fa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:28.329558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b604e-a92e-4a3e-8961-9b00990e16fa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:28.329827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b604e-a92e-4a3e-8961-9b00990e16fa None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:28.330468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b604e-a92e-4a3e-8961-9b00990e16fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:28.330769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b604e-a92e-4a3e-8961-9b00990e16fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:28.332308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b604e-a92e-4a3e-8961-9b00990e16fa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:28.351857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:28.375924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:28.396281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfed0f-ad9d-41e0-b577-f6d27187e11f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:28.432467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5864ed-d334-4891-ba40-bdb6583208af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:28.433145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5864ed-d334-4891-ba40-bdb6583208af None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:28.433431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5864ed-d334-4891-ba40-bdb6583208af None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:28.433709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5864ed-d334-4891-ba40-bdb6583208af None admin] PATH_INFO: `/v3/domains/default/users/733666fc411e4b24a7cb942e8e901594/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:28.435714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5864ed-d334-4891-ba40-bdb6583208af None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=733666fc411e4b24a7cb942e8e901594, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:28.437233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5864ed-d334-4891-ba40-bdb6583208af None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:28.552993 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 11/21] 10.222.0.45 () {58 vars in 1361 bytes} [Wed Oct 12 12:15:28 2022] PUT /identity/v3/domains/default/users/733666fc411e4b24a7cb942e8e901594/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:15:30.746922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06b451-03ca-4b1c-95c8-5a2316c84718 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:30.747430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06b451-03ca-4b1c-95c8-5a2316c84718 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:30.747531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06b451-03ca-4b1c-95c8-5a2316c84718 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:30.748821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:30.757493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbce3-2a45-4f59-b0fe-8fa2a42b75bf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:30.757493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbce3-2a45-4f59-b0fe-8fa2a42b75bf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:30.757493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbce3-2a45-4f59-b0fe-8fa2a42b75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:30.781593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-239cbce3-2a45-4f59-b0fe-8fa2a42b75bf None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:30.783123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-239cbce3-2a45-4f59-b0fe-8fa2a42b75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:30.875294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:31.291629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7566-c95f-4298-9a23-556ee026eaf3 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.291967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7566-c95f-4298-9a23-556ee026eaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.292358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7566-c95f-4298-9a23-556ee026eaf3 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.294019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:31.299610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ff20b-9985-4927-8166-cc934c8ad397 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.299939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ff20b-9985-4927-8166-cc934c8ad397 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.300226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ff20b-9985-4927-8166-cc934c8ad397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.324793 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-be6ff20b-9985-4927-8166-cc934c8ad397 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:31.326006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-be6ff20b-9985-4927-8166-cc934c8ad397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:31.355462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7566-c95f-4298-9a23-556ee026eaf3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:31.467161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:31.475756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:31.477045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493208-4233-4864-9e5e-35d057b4d610 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.477337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493208-4233-4864-9e5e-35d057b4d610 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.477621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493208-4233-4864-9e5e-35d057b4d610 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.481728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:31.488204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2cd4-007d-46fb-bfb5-78c7e6e0e11a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.489032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2cd4-007d-46fb-bfb5-78c7e6e0e11a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.489320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2cd4-007d-46fb-bfb5-78c7e6e0e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.524372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:31.529736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fcfa2cd4-007d-46fb-bfb5-78c7e6e0e11a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:31.529736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fcfa2cd4-007d-46fb-bfb5-78c7e6e0e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:31.560601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7566-c95f-4298-9a23-556ee026eaf3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:31.606650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:31.607670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.608208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.608703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.618037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 15/27] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:31.619314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322f56-9200-4181-9b48-7baf570ff10b None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.619610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322f56-9200-4181-9b48-7baf570ff10b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.624825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:31.631836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322f56-9200-4181-9b48-7baf570ff10b None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.631836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 16/28] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:31.633187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:31.643082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0107e-aca5-48d1-a5ba-d2050a4d7677 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.643390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0107e-aca5-48d1-a5ba-d2050a4d7677 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.643679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0107e-aca5-48d1-a5ba-d2050a4d7677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:15:31.653155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:31.654042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:15:31.654847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:15:31.654847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:15:31.654847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:31.656714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 13/29] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:31.662980 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:31.684100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-98f0107e-aca5-48d1-a5ba-d2050a4d7677 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:31.684100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-98f0107e-aca5-48d1-a5ba-d2050a4d7677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:31.827956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 17/30] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:31.874512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb9156-d2dd-41f6-9e12-7517c35bef99 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:31.888564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0107e-aca5-48d1-a5ba-d2050a4d7677 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:31.931254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:31.940228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:31.940846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:31.941135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:31.941412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:31.942596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:31.942905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:31.944481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:31.968330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 14/31] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:31.974324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:32.012839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:32.093411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0107e-aca5-48d1-a5ba-d2050a4d7677 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:32.158528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:32.159518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.160026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.161031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.161941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:32.163650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:32.167576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd565816-4460-43cd-8048-d0dfdc0b44c0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:32.189435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 18/32] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 12 12:15:31 2022] POST /identity/v3/roles => generated 219 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:15:32.190567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:32.248469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:32.249099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.249383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.249658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.250334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:32.252139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:32.360226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca842-b576-4327-a5a2-bb6a7f959a56 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:32.383896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:32.402219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:32.403051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.403482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.403960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.404970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:32.406517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:32.426410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 19/33] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 12 12:15:32 2022] POST /identity/v3/roles => generated 225 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:32.427786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:32.482512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 15/34] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:15:31 2022] POST /identity/v3/projects => generated 301 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:32.561497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e807-735f-43b2-9e42-52fd47d799ae None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:32.606363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71880ea1-ff49-4a24-8b66-315a343ab3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:32.607320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71880ea1-ff49-4a24-8b66-315a343ab3be None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.607756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71880ea1-ff49-4a24-8b66-315a343ab3be None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.608202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71880ea1-ff49-4a24-8b66-315a343ab3be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.622515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71880ea1-ff49-4a24-8b66-315a343ab3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-71880ea1-ff49-4a24-8b66-315a343ab3be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:32.627981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:32.629652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:32.630603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:32.632817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 20/35] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:32.639188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:32.726217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:32.763983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cc2d-c982-48ce-b88f-927d993cecae None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.764619 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cc2d-c982-48ce-b88f-927d993cecae None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.765110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cc2d-c982-48ce-b88f-927d993cecae None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.766702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 21/36] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:32 2022] GET /identity => generated 270 bytes in 118 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:32.767688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad0a91-9a93-4aac-91eb-7d468d675141 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.768024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad0a91-9a93-4aac-91eb-7d468d675141 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.768367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad0a91-9a93-4aac-91eb-7d468d675141 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.769506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 22/37] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:32.776203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b8b3-5c77-4ebd-8527-c3801f9d6d8a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.777723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b8b3-5c77-4ebd-8527-c3801f9d6d8a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.777723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b8b3-5c77-4ebd-8527-c3801f9d6d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.798172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd071d-ca96-45ed-8003-535a4c61bfd6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:32.798348 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5836b8b3-5c77-4ebd-8527-c3801f9d6d8a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:32.799499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5836b8b3-5c77-4ebd-8527-c3801f9d6d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:32.837623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf9c0b-f928-4e74-90dc-5078d387128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:32.838255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9c0b-f928-4e74-90dc-5078d387128d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.838545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9c0b-f928-4e74-90dc-5078d387128d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.838831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9c0b-f928-4e74-90dc-5078d387128d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.839524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9c0b-f928-4e74-90dc-5078d387128d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:32.839895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9c0b-f928-4e74-90dc-5078d387128d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:32.840300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:32.841478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9c0b-f928-4e74-90dc-5078d387128d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:32.855415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 16/38] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:32.857076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505c85-a25a-4ed7-a37b-3224b4956afe None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:32.857076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505c85-a25a-4ed7-a37b-3224b4956afe None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:32.857362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505c85-a25a-4ed7-a37b-3224b4956afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:32.875565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2e505c85-a25a-4ed7-a37b-3224b4956afe None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:32.877054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2e505c85-a25a-4ed7-a37b-3224b4956afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:32.877589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 23/39] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:32.878430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b8b3-5c77-4ebd-8527-c3801f9d6d8a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:32.952564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 17/40] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:32.981166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b8b3-5c77-4ebd-8527-c3801f9d6d8a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:33.015127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:33.015758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:33.016074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:33.016352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] PATH_INFO: `/v3/users/733666fc411e4b24a7cb942e8e901594` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:33.017480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] RBAC: Authorizing `identity:get_user(user_id=733666fc411e4b24a7cb942e8e901594)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:33.018924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:33.021237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 24/41] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:32 2022] GET /identity/v3/users/733666fc411e4b24a7cb942e8e901594 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:33.026499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e505c85-a25a-4ed7-a37b-3224b4956afe None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:33.062386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:33.128942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e505c85-a25a-4ed7-a37b-3224b4956afe None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:33.145606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:33.164070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:33.164701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:33.164983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:33.165254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:33.166364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:33.167841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:33.169638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 18/42] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:33.175042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:33.187899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:33.250790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe9feb-8503-486a-acbf-61dceb968011 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:33.278290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f23de-dde8-4191-8be8-f389e2759c9c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:33.280547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:33.284978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:33.286167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:33.286461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:33.286742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:33.287891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:33.289344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:33.290913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 25/43] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:33.291664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:33.312926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:33.313527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:33.313839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:33.314111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:33.314837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.domain.id=default, user.id=733666fc411e4b24a7cb942e8e901594) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:33.315304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:33.316799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:33.325467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 19/44] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Oct 12 12:15:33 2022] GET /identity/v3/role_assignments?user.id=733666fc411e4b24a7cb942e8e901594&scope.domain.id=default&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:33.326223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:33.401501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df562eb-49e6-437c-987c-002938eb2f1d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:33.409747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:33.440385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd16da9-0ad5-40df-a62c-2460b568e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:33.441091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16da9-0ad5-40df-a62c-2460b568e2d8 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:33.441373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16da9-0ad5-40df-a62c-2460b568e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:33.442191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16da9-0ad5-40df-a62c-2460b568e2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:33.442926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16da9-0ad5-40df-a62c-2460b568e2d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:33.444540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16da9-0ad5-40df-a62c-2460b568e2d8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:33.458667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6cd1d-ab4d-45e7-86ef-e29eaf4c9543 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:33.468013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 26/45] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 12 12:15:33 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:33.499315 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6ac8-a859-41ec-9f5c-55ba5e90298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:33.500014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6ac8-a859-41ec-9f5c-55ba5e90298f None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:33.500286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6ac8-a859-41ec-9f5c-55ba5e90298f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:33.501053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6ac8-a859-41ec-9f5c-55ba5e90298f None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:33.501243 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6ac8-a859-41ec-9f5c-55ba5e90298f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:33.502746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6ac8-a859-41ec-9f5c-55ba5e90298f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:33.532657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 20/46] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:15:33 2022] POST /identity/v3/projects => generated 312 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:35.681540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74abbd-e25a-4337-a82c-957680e4bd7c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:35.682084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74abbd-e25a-4337-a82c-957680e4bd7c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:35.682084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74abbd-e25a-4337-a82c-957680e4bd7c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:35.683445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 27/47] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:35.688612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a84ab-beae-4bc4-b53b-555d2e076046 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:35.689031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a84ab-beae-4bc4-b53b-555d2e076046 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:35.689175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a84ab-beae-4bc4-b53b-555d2e076046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:35.708229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d67a84ab-beae-4bc4-b53b-555d2e076046 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:35.709434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d67a84ab-beae-4bc4-b53b-555d2e076046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:35.722846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:35.775418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 21/48] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:36.041105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74abbd-e25a-4337-a82c-957680e4bd7c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:36.138454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74abbd-e25a-4337-a82c-957680e4bd7c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:36.169914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832e1aa-ec6e-49f5-9970-1a774363bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:36.170519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e1aa-ec6e-49f5-9970-1a774363bc8d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:36.170797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e1aa-ec6e-49f5-9970-1a774363bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:36.171066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e1aa-ec6e-49f5-9970-1a774363bc8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:36.172189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e1aa-ec6e-49f5-9970-1a774363bc8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:36.173616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e1aa-ec6e-49f5-9970-1a774363bc8d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:36.175131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 28/49] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:36.181045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a84ab-beae-4bc4-b53b-555d2e076046 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:36.275698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a84ab-beae-4bc4-b53b-555d2e076046 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:36.308010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba576c45-9cdb-4938-95fc-d2c865c4dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:36.308551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba576c45-9cdb-4938-95fc-d2c865c4dcb6 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:36.308835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba576c45-9cdb-4938-95fc-d2c865c4dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:36.309109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba576c45-9cdb-4938-95fc-d2c865c4dcb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:36.309748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba576c45-9cdb-4938-95fc-d2c865c4dcb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:36.311180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba576c45-9cdb-4938-95fc-d2c865c4dcb6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:36.336062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 22/50] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Oct 12 12:15:36 2022] POST /identity/v3/projects => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:38.472418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9c92-ca3a-453c-b702-51b682e0c6c4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:38.472927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9c92-ca3a-453c-b702-51b682e0c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:38.473010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9c92-ca3a-453c-b702-51b682e0c6c4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:38.474882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 29/51] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:38.480183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e85f4-b5aa-40bd-ba40-c4854572368c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:38.480584 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e85f4-b5aa-40bd-ba40-c4854572368c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:38.480741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e85f4-b5aa-40bd-ba40-c4854572368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:38.486984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:38.499902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-024e85f4-b5aa-40bd-ba40-c4854572368c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:38.501079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-024e85f4-b5aa-40bd-ba40-c4854572368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:38.564747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 23/52] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:38.830053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9c92-ca3a-453c-b702-51b682e0c6c4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:38.864322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:38.929357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9c92-ca3a-453c-b702-51b682e0c6c4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:38.962452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6473bbc-d275-488d-815a-5b5f3f808d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:38.963066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473bbc-d275-488d-815a-5b5f3f808d6e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:38.963351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473bbc-d275-488d-815a-5b5f3f808d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:38.963628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473bbc-d275-488d-815a-5b5f3f808d6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:38.964759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6473bbc-d275-488d-815a-5b5f3f808d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:38.966197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6473bbc-d275-488d-815a-5b5f3f808d6e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:38.967735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 30/53] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:38.973086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e85f4-b5aa-40bd-ba40-c4854572368c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:39.068074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e85f4-b5aa-40bd-ba40-c4854572368c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:39.096044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:39.101488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7d2b-05e2-4fd5-b506-cbcadb27c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:39.102088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7d2b-05e2-4fd5-b506-cbcadb27c6cc None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:39.102373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7d2b-05e2-4fd5-b506-cbcadb27c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:39.102649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7d2b-05e2-4fd5-b506-cbcadb27c6cc None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:39.103302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7d2b-05e2-4fd5-b506-cbcadb27c6cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:39.104786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7d2b-05e2-4fd5-b506-cbcadb27c6cc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:39.132887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 24/54] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:15:38 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:42.344250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610f82-59b6-4dd7-abf6-9aba598ed510 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.345310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610f82-59b6-4dd7-abf6-9aba598ed510 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.345799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610f82-59b6-4dd7-abf6-9aba598ed510 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.347618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 31/55] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:42.353121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6982-fd63-4511-b4a1-5f8a7811a07a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.353901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6982-fd63-4511-b4a1-5f8a7811a07a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.354388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6982-fd63-4511-b4a1-5f8a7811a07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.384857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-220e6982-fd63-4511-b4a1-5f8a7811a07a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:42.386081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-220e6982-fd63-4511-b4a1-5f8a7811a07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:42.428721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268264-2fd3-47a0-8f5a-8cd2c5df212e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.429292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268264-2fd3-47a0-8f5a-8cd2c5df212e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.429792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268264-2fd3-47a0-8f5a-8cd2c5df212e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.431324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 32/56] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:42.443856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301b74a-da8d-4c04-a853-81e2474f96d6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.444367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301b74a-da8d-4c04-a853-81e2474f96d6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.444837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301b74a-da8d-4c04-a853-81e2474f96d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.472713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 25/57] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:42.483869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f301b74a-da8d-4c04-a853-81e2474f96d6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:42.485061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f301b74a-da8d-4c04-a853-81e2474f96d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:42.580168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 33/58] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:42.684565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d240-7b97-4274-8953-cd049fa8ea4f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.684850 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d240-7b97-4274-8953-cd049fa8ea4f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.685050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d240-7b97-4274-8953-cd049fa8ea4f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.686897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 26/59] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:42.692048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d26d-ecd9-4b1d-8c68-0bc6bc9b2469 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.692883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d26d-ecd9-4b1d-8c68-0bc6bc9b2469 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.693525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d26d-ecd9-4b1d-8c68-0bc6bc9b2469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.720016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b141d26d-ecd9-4b1d-8c68-0bc6bc9b2469 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:42.721244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b141d26d-ecd9-4b1d-8c68-0bc6bc9b2469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:42.754264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:42.829445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 34/60] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:42.863161 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61af8-d884-4123-aa3f-2bda15901440 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.863490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61af8-d884-4123-aa3f-2bda15901440 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.863953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61af8-d884-4123-aa3f-2bda15901440 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.865958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 27/61] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:42.871198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b65aa-9e6e-4703-b818-7e34370942df None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:42.871497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b65aa-9e6e-4703-b818-7e34370942df None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:42.871780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b65aa-9e6e-4703-b818-7e34370942df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:42.882727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c61af8-d884-4123-aa3f-2bda15901440 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:42.896001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fb3b65aa-9e6e-4703-b818-7e34370942df None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:42.897180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fb3b65aa-9e6e-4703-b818-7e34370942df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:42.982484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 35/62] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:42.988812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b65aa-9e6e-4703-b818-7e34370942df None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.112749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c61af8-d884-4123-aa3f-2bda15901440 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.144487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.154206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.167549 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b65aa-9e6e-4703-b818-7e34370942df None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.171686 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.172357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.172798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.173219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.189514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:43.198261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:43.199588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:43.200457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:43.202789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 28/63] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:15:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:15:43.203892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.204930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.205569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.205849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.206125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.217540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:43.222855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:43.224420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:43.225258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:43.227174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 36/64] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:43.228116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.316368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dc08a-c246-4bd5-a77e-ab76f2e15f3d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.333664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee617a5-5524-4ec8-9b12-de92d928a1c5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.350591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.351227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.351510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.351815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.361862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:43.367128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f5b4f-a346-4d31-a4c3-2020538a0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:43.367665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:43.368535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:15:43.369486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:43.370280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f5b4f-a346-4d31-a4c3-2020538a0c8f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.370280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f5b4f-a346-4d31-a4c3-2020538a0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.370280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f5b4f-a346-4d31-a4c3-2020538a0c8f None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.370490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 29/65] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:43.370574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f5b4f-a346-4d31-a4c3-2020538a0c8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:43.370574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f5b4f-a346-4d31-a4c3-2020538a0c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:43.370574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f5b4f-a346-4d31-a4c3-2020538a0c8f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:43.373121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.379153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 37/66] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:43.380389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04dda-bd4a-4414-b78b-92cb19867846 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.380677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04dda-bd4a-4414-b78b-92cb19867846 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.381014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04dda-bd4a-4414-b78b-92cb19867846 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.382234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 38/67] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:43.382931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04dda-bd4a-4414-b78b-92cb19867846 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.398053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.415206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.474797 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48854b24-7cd1-4e77-9b53-659abc67d7c5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.481654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04dda-bd4a-4414-b78b-92cb19867846 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.507283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.507923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.508208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.508482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.509145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:43.509449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:43.510837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:43.514387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.515012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.515299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.515575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.518698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 30/68] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:43.519498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.526335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:43.531157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:43.532134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 39/69] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:43.534328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.607459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.618543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.621518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d5087-3c9e-4bec-a138-c8c14a51f893 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.632927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e73d9-4e79-49f5-9688-9d97d4feaff5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.655991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac89df-2ebc-447c-abf0-61d27937fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.656678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac89df-2ebc-447c-abf0-61d27937fcde None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.656958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac89df-2ebc-447c-abf0-61d27937fcde None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.657246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac89df-2ebc-447c-abf0-61d27937fcde None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.657899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac89df-2ebc-447c-abf0-61d27937fcde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:43.658202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac89df-2ebc-447c-abf0-61d27937fcde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:43.659571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac89df-2ebc-447c-abf0-61d27937fcde None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:43.667049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.667673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.668128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 31/70] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:43.668231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.668231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] PATH_INFO: `/v3/users/733666fc411e4b24a7cb942e8e901594` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.668954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98738d-d268-4629-89bb-81717c9eee7e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.669228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98738d-d268-4629-89bb-81717c9eee7e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.669390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] RBAC: Authorizing `identity:get_user(user_id=733666fc411e4b24a7cb942e8e901594)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:43.669484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98738d-d268-4629-89bb-81717c9eee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.670840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:43.675543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 40/71] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/users/733666fc411e4b24a7cb942e8e901594 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:43.675543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.690273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7b98738d-d268-4629-89bb-81717c9eee7e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:43.691456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7b98738d-d268-4629-89bb-81717c9eee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:43.756437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 32/72] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:43.757194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98738d-d268-4629-89bb-81717c9eee7e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.782972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05922894-cd8c-4da1-9cd6-c8637c35672a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.819696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.820358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.820640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.820914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] PATH_INFO: `/v3/users/d8f8c179d1464c7c9b321899a46d8739` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.831903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.835358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] RBAC: Authorizing `identity:get_user(user_id=d8f8c179d1464c7c9b321899a46d8739)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:43.837473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:43.843966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 41/73] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/users/d8f8c179d1464c7c9b321899a46d8739 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:43.843966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.857524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:43.867305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98738d-d268-4629-89bb-81717c9eee7e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.903679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.904414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.904703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.904981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.905652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:43.905960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:43.907603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:43.920826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 33/74] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:43.921558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:43.947008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248cbe-bb25-4314-b8bd-31df3d374c3c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:43.982047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:43.982683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:43.982971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:43.983249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] PATH_INFO: `/v3/users/d8f8c179d1464c7c9b321899a46d8739` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:43.984393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] RBAC: Authorizing `identity:get_user(user_id=d8f8c179d1464c7c9b321899a46d8739)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:43.986094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:43.992213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 42/75] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/users/d8f8c179d1464c7c9b321899a46d8739 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:43.992213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.030430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd597e-e756-4ffd-9fc6-0da958135038 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.058077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.063503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.064164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.064447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.064721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.065845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.067820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.069453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 34/76] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:44.070208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.093125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21350f23-13e4-4cd1-a6fe-f3da4e172a67 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.095345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.125882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.126444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.126731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.127020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.128183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.129642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.131826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 43/77] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:43 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:44.132599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.173569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b97f0-087c-4dce-82e9-227133b6424b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.208531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.209176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.209460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.209736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] PATH_INFO: `/v3/users/d8f8c179d1464c7c9b321899a46d8739` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.211096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] RBAC: Authorizing `identity:get_user(user_id=d8f8c179d1464c7c9b321899a46d8739)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.212570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.214144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 35/78] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:44 2022] GET /identity/v3/users/d8f8c179d1464c7c9b321899a46d8739 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:44.214901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.228652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca3e19-bedb-4f59-af8e-003aa89b8a30 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.261588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.262208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.262492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.262765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.263894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.265322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.266923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 44/79] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:44 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:44.267651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.270808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.309711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.319975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461957-fdae-434c-aabf-52e262b7618d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.353085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.353710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.353994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.354269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.355386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.356930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.358498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 36/80] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:44.358498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.366968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cb65b-4324-4a20-bb9a-1d89f76b0132 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.399618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.400240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.400496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.400782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/733666fc411e4b24a7cb942e8e901594/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.402702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] RBAC: Authorizing `identity:create_grant(project_id=a026f5fdee4d46e8bc11a247752d347e, user_id=733666fc411e4b24a7cb942e8e901594, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.404203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.415934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 45/81] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:15:44 2022] PUT /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/733666fc411e4b24a7cb942e8e901594/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:15:44.416723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.479431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99440a-fe6c-427d-aac2-3080152a1274 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.485330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.520017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.520742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.521032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.521314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/d8f8c179d1464c7c9b321899a46d8739/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.523861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a026f5fdee4d46e8bc11a247752d347e, user_id=d8f8c179d1464c7c9b321899a46d8739, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.525370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.529264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714858c-3348-411b-9c3f-6c27ce2b6999 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.544535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 37/82] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:15:44 2022] PUT /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/d8f8c179d1464c7c9b321899a46d8739/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:15:44.549313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.572511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.573164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.573450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.573735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] PATH_INFO: `/v3/projects/2b250bd3cd9c486d9bbb5598a494cad0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.575695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] RBAC: Authorizing `identity:get_project(project_id=2b250bd3cd9c486d9bbb5598a494cad0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.577442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.579400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 46/83] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:44 2022] GET /identity/v3/projects/2b250bd3cd9c486d9bbb5598a494cad0 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:44.580280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.588123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.706391 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55ff3f-d0b2-408c-9f84-d7091e1bbca6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.711600 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c40de-53e4-4c49-baa1-bbca47126c90 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.752646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.757032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.759151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39421c-7061-436e-9f09-417442538873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.759758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39421c-7061-436e-9f09-417442538873 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.760241 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39421c-7061-436e-9f09-417442538873 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.760536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39421c-7061-436e-9f09-417442538873 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.761186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39421c-7061-436e-9f09-417442538873 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.761583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.762065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.762552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/d8f8c179d1464c7c9b321899a46d8739/roles/1aeee7a88610411d8ff149cc0528f706` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.762652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39421c-7061-436e-9f09-417442538873 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.765192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] RBAC: Authorizing `identity:create_grant(project_id=a026f5fdee4d46e8bc11a247752d347e, user_id=d8f8c179d1464c7c9b321899a46d8739, role_id=1aeee7a88610411d8ff149cc0528f706)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.766912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.792423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 38/84] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:15:44 2022] PUT /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/d8f8c179d1464c7c9b321899a46d8739/roles/1aeee7a88610411d8ff149cc0528f706 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:15:44.793248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:44.799369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 47/85] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:15:44 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:44.892128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:44.919249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e85fc-d9bf-4b7c-91f4-5741d0a7e83f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:44.961613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e91706-46fd-4874-b60b-d95c6415d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:44.962674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e91706-46fd-4874-b60b-d95c6415d529 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:44.963164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e91706-46fd-4874-b60b-d95c6415d529 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:44.963658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e91706-46fd-4874-b60b-d95c6415d529 None admin] PATH_INFO: `/v3/projects/2b250bd3cd9c486d9bbb5598a494cad0/users/d8f8c179d1464c7c9b321899a46d8739/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:44.966034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e91706-46fd-4874-b60b-d95c6415d529 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b250bd3cd9c486d9bbb5598a494cad0, user_id=d8f8c179d1464c7c9b321899a46d8739, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:44.967759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e91706-46fd-4874-b60b-d95c6415d529 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:44.984273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 39/86] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:15:44 2022] PUT /identity/v3/projects/2b250bd3cd9c486d9bbb5598a494cad0/users/d8f8c179d1464c7c9b321899a46d8739/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:15:47.025450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f472-078c-42ea-bb46-551df783adf7 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:47.025928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f472-078c-42ea-bb46-551df783adf7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:47.025928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f472-078c-42ea-bb46-551df783adf7 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:47.027514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 48/87] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:47.032627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157496-11f6-4106-a83d-2386a2547bf7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:47.033027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157496-11f6-4106-a83d-2386a2547bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:47.033251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38157496-11f6-4106-a83d-2386a2547bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:47.060841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-38157496-11f6-4106-a83d-2386a2547bf7 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:47.062078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-38157496-11f6-4106-a83d-2386a2547bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:47.145972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 40/88] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:47.322412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109f6e-582a-40e5-981c-17fe0324b0e4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:47.322725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109f6e-582a-40e5-981c-17fe0324b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:47.323024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109f6e-582a-40e5-981c-17fe0324b0e4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:47.324554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 49/89] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:47.337148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92f736-0c18-496f-9935-3eb853acadf8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:47.337446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92f736-0c18-496f-9935-3eb853acadf8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:47.337730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92f736-0c18-496f-9935-3eb853acadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:47.364794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ea92f736-0c18-496f-9935-3eb853acadf8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:47.366120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ea92f736-0c18-496f-9935-3eb853acadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:47.430969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:47.441864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 41/90] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:47.686126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80109f6e-582a-40e5-981c-17fe0324b0e4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:47.825061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80109f6e-582a-40e5-981c-17fe0324b0e4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:47.879442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806e56-a613-40e3-86f9-0cba8536dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:47.880237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806e56-a613-40e3-86f9-0cba8536dafc None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:47.880527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806e56-a613-40e3-86f9-0cba8536dafc None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:47.880804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806e56-a613-40e3-86f9-0cba8536dafc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:47.895408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806e56-a613-40e3-86f9-0cba8536dafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-52806e56-a613-40e3-86f9-0cba8536dafc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:47.900470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:47.901298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:47.902089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 50/91] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:47.907746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92f736-0c18-496f-9935-3eb853acadf8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:47.962424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3a0c0-ff9c-43b1-bd13-8c9afc1db6df None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:47.962710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3a0c0-ff9c-43b1-bd13-8c9afc1db6df None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:47.962902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3a0c0-ff9c-43b1-bd13-8c9afc1db6df None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:47.964586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 51/92] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:47.973120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164fa0-b37f-4bac-8844-f29ada780379 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:47.973404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164fa0-b37f-4bac-8844-f29ada780379 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:47.973682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10164fa0-b37f-4bac-8844-f29ada780379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.009120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-10164fa0-b37f-4bac-8844-f29ada780379 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:48.013279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-10164fa0-b37f-4bac-8844-f29ada780379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:48.016161 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92f736-0c18-496f-9935-3eb853acadf8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:48.057442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdf900-020b-4f7b-b113-c1bd3cce9041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:48.058090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdf900-020b-4f7b-b113-c1bd3cce9041 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.062368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdf900-020b-4f7b-b113-c1bd3cce9041 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.062368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdf900-020b-4f7b-b113-c1bd3cce9041 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.062368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdf900-020b-4f7b-b113-c1bd3cce9041 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:48.062368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdf900-020b-4f7b-b113-c1bd3cce9041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:48.062368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdf900-020b-4f7b-b113-c1bd3cce9041 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:48.077470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 42/93] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:48.084153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61553105-f168-48bc-b192-aa93351d2b68 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.084460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61553105-f168-48bc-b192-aa93351d2b68 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.084750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61553105-f168-48bc-b192-aa93351d2b68 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.086136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 43/94] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:48.086866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61553105-f168-48bc-b192-aa93351d2b68 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:48.108305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:48.151318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 52/95] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 12 12:15:48.161213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164fa0-b37f-4bac-8844-f29ada780379 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:48.268416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:48.365311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61553105-f168-48bc-b192-aa93351d2b68 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:48.420135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10164fa0-b37f-4bac-8844-f29ada780379 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:48.440256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70aa20-3491-4f6b-8574-04fdd8ae0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:48.440896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70aa20-3491-4f6b-8574-04fdd8ae0d3d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.441180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70aa20-3491-4f6b-8574-04fdd8ae0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.441458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70aa20-3491-4f6b-8574-04fdd8ae0d3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.471027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70aa20-3491-4f6b-8574-04fdd8ae0d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-fe70aa20-3491-4f6b-8574-04fdd8ae0d3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:48.485406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:48.486310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:48.487068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 44/96] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:48.497221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12afda-68c9-4519-b82b-34dca72e8e71 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.499828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12afda-68c9-4519-b82b-34dca72e8e71 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.499828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12afda-68c9-4519-b82b-34dca72e8e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.545045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3c12afda-68c9-4519-b82b-34dca72e8e71 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:48.545207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:48.545647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.545937 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.546214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] PATH_INFO: `/v3/users/733666fc411e4b24a7cb942e8e901594` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.546310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c12afda-68c9-4519-b82b-34dca72e8e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:48.547732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] RBAC: Authorizing `identity:get_user(user_id=733666fc411e4b24a7cb942e8e901594)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:48.549614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:48.551598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 53/97] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:48 2022] GET /identity/v3/users/733666fc411e4b24a7cb942e8e901594 => generated 247 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:48.553156 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:48.622052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:48.637295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 45/98] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:48.638151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12afda-68c9-4519-b82b-34dca72e8e71 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:48.691907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:48.696404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f700-ccad-4544-bc4b-6bc853939f4e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:48.731167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:48.731770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.732082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.732356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.733030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:48.733333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:48.734721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:48.743358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 54/99] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:48.746294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12afda-68c9-4519-b82b-34dca72e8e71 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:48.748905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:48.788107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1dafc-0cf8-4c4f-b6ef-b48b881e2e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:48.788912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1dafc-0cf8-4c4f-b6ef-b48b881e2e7d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.789221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1dafc-0cf8-4c4f-b6ef-b48b881e2e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.790256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1dafc-0cf8-4c4f-b6ef-b48b881e2e7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.802107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1dafc-0cf8-4c4f-b6ef-b48b881e2e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f6a1dafc-0cf8-4c4f-b6ef-b48b881e2e7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:48.806911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:48.807943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:48.808721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 46/100] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:48.809718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cebb63-2519-45b8-a98c-cab76d64a08b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.810005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cebb63-2519-45b8-a98c-cab76d64a08b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.810284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cebb63-2519-45b8-a98c-cab76d64a08b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.811531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 47/101] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:48.812752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269acde3-3b2e-4cfe-95e9-df42b0c2834d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.813051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269acde3-3b2e-4cfe-95e9-df42b0c2834d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.813327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269acde3-3b2e-4cfe-95e9-df42b0c2834d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.814634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 48/102] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:48.819789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269acde3-3b2e-4cfe-95e9-df42b0c2834d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:48.866193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3e0e5-ff84-4e80-a7d8-418a52793928 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:48.875596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:48.901704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59cd0-e2e9-412c-9b13-d9c02c9c8c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:48.902717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59cd0-e2e9-412c-9b13-d9c02c9c8c76 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.903004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59cd0-e2e9-412c-9b13-d9c02c9c8c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.903347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59cd0-e2e9-412c-9b13-d9c02c9c8c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.926007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269acde3-3b2e-4cfe-95e9-df42b0c2834d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:48.936426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:48.960782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575e2b1-58ef-4429-b25b-56442ec9d23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:48.961408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575e2b1-58ef-4429-b25b-56442ec9d23a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.961691 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575e2b1-58ef-4429-b25b-56442ec9d23a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.961968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575e2b1-58ef-4429-b25b-56442ec9d23a None admin] PATH_INFO: `/v3/users/d8f8c179d1464c7c9b321899a46d8739` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.963083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575e2b1-58ef-4429-b25b-56442ec9d23a None admin] RBAC: Authorizing `identity:get_user(user_id=d8f8c179d1464c7c9b321899a46d8739)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:48.964561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575e2b1-58ef-4429-b25b-56442ec9d23a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:48.966133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 49/103] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:48 2022] GET /identity/v3/users/d8f8c179d1464c7c9b321899a46d8739 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:48.967227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136403-4cea-420f-9fc9-11362d66bce5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:48.967571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136403-4cea-420f-9fc9-11362d66bce5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:48.967877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136403-4cea-420f-9fc9-11362d66bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:48.971457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59cd0-e2e9-412c-9b13-d9c02c9c8c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:48.972947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59cd0-e2e9-412c-9b13-d9c02c9c8c76 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:48.986121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b8136403-4cea-420f-9fc9-11362d66bce5 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:48.987304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b8136403-4cea-420f-9fc9-11362d66bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:49.051784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 50/104] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:49.053439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136403-4cea-420f-9fc9-11362d66bce5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.076019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 55/105] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:15:49.077936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e8d77-6edf-48c2-841f-0fbf3befe977 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.078443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e8d77-6edf-48c2-841f-0fbf3befe977 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.079236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e8d77-6edf-48c2-841f-0fbf3befe977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.099762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-502e8d77-6edf-48c2-841f-0fbf3befe977 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:49.101089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-502e8d77-6edf-48c2-841f-0fbf3befe977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:49.103024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.161397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136403-4cea-420f-9fc9-11362d66bce5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.175831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 56/106] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:49.175831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e8d77-6edf-48c2-841f-0fbf3befe977 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.177051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.198097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.198716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.198989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.199266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.200214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:49.200520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.201916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.210874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 51/107] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:49.216088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.302267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e8d77-6edf-48c2-841f-0fbf3befe977 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.316875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f361fc-5f00-4a21-90de-d7b6f3a833cd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.342579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.343298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.343484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.343759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.350732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.352918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.353518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.353800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.354078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.354845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:49.360213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:49.361065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:15:49.361830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:49.363685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 57/108] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:49.369057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.394689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.425482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.427082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.480424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e6040-5ba9-4787-8e7f-134df85f0090 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.515425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.516077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.516365 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.516636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.517762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.519215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.520955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 58/109] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:49.521633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.526417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 52/110] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:15:49.527150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.585399 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.595156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.619473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819848a-27a2-4179-b7aa-3509b8ddb329 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.625255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cdc8f-13e6-4e5f-a5bb-5c36e41bbf13 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.651822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.652463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.652743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.653016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] PATH_INFO: `/v3/users/d8f8c179d1464c7c9b321899a46d8739` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.654132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] RBAC: Authorizing `identity:get_user(user_id=d8f8c179d1464c7c9b321899a46d8739)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.655582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.657184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 59/111] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/users/d8f8c179d1464c7c9b321899a46d8739 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:49.657945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.663134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.663768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.664076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.664349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.674348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:49.679672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:49.680548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:49.681331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 53/112] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:49.682004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.760528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19d1a-9015-4bc6-9933-9c850b29f2be None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.780555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7121-bcd5-4d01-a079-28f22cec7e48 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.794100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.794709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.794994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.795271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.795967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:49.796273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.797652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.798953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.807575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 60/113] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:49.808403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.813405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:49.821391 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.822027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.822312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.822592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.823710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.825450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.827166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 54/114] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:49.827774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.904774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af26277-a8fb-486f-9c67-7d943cf2ee0a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.924675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb471b22-3de7-4745-a300-0f8295aee37f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:49.938184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.938782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.939067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.939341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.940101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=a026f5fdee4d46e8bc11a247752d347e, user.id=733666fc411e4b24a7cb942e8e901594) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:49.940416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.941867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.948804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 61/115] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/role_assignments?user.id=733666fc411e4b24a7cb942e8e901594&scope.project.id=a026f5fdee4d46e8bc11a247752d347e&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:49.949586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:49.959442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:49.960138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:49.960416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:49.960693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:49.961909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:49.963414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:49.970548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 55/116] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:49.970548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.021615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.049228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.070609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dc02b-02ac-400b-89d4-4893c92a156a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.088222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e5eab-b5a0-4bf0-8139-2e65d0d07b09 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.108459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.109435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.109899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.110353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.131069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.131681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.131998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.132271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.132941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:50.133244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.134958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.144243 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 56/117] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:50.149068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.191327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.192912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.248415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.249131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7b17-cee0-4cc4-9571-22c7981dc506 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.275002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.282879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.283509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.283792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.284099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] PATH_INFO: `/v3/users/dfcf1ac07172414b8daec317b5f09719` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.290596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 62/118] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:15:50.291405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.302677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] RBAC: Authorizing `identity:get_user(user_id=dfcf1ac07172414b8daec317b5f09719)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.304174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.310254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 57/119] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:50 2022] GET /identity/v3/users/dfcf1ac07172414b8daec317b5f09719 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:50.310254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.390495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae593795-d1bf-4d75-9ebd-3569c4636ada None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.401872 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c69a-f588-42f1-acac-68f7d4e8da8a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.424158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.424754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.425037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.425312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.425956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.427425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.435006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.435608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.435920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.436199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.437334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] RBAC: Adding query filter params (role.id=5b5518e8da0949ae9f1215f2739e508b, scope.project.id=a026f5fdee4d46e8bc11a247752d347e, user.id=d8f8c179d1464c7c9b321899a46d8739) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:50.437650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.439075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.444866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 58/120] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:15:50 2022] GET /identity/v3/role_assignments?user.id=d8f8c179d1464c7c9b321899a46d8739&scope.project.id=a026f5fdee4d46e8bc11a247752d347e&role.id=5b5518e8da0949ae9f1215f2739e508b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:50.445717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.464428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 63/121] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:15:50 2022] POST /identity/v3/projects => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:50.465032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.491688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.514883 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.597703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b888-d643-446f-a259-c9bf41f7fb6b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.607124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6a54-ca7a-44ad-b3cb-17db4076dbe4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.651444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.651665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.652293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.652581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.652835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.652939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] PATH_INFO: `/v3/projects/2b250bd3cd9c486d9bbb5598a494cad0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.653379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.653825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] PATH_INFO: `/v3/users/d8f8c179d1464c7c9b321899a46d8739` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.654268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] RBAC: Authorizing `identity:get_project(project_id=2b250bd3cd9c486d9bbb5598a494cad0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.654999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] RBAC: Authorizing `identity:get_user(user_id=d8f8c179d1464c7c9b321899a46d8739)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.655778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.656492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.658411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 59/123] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:50 2022] GET /identity/v3/users/d8f8c179d1464c7c9b321899a46d8739 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:50.658524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 64/123] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:50 2022] GET /identity/v3/projects/2b250bd3cd9c486d9bbb5598a494cad0 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:50.659215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.664307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.761242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.780226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9bbd-6582-4709-a358-6165768c33fc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.783288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792999-2629-46f5-9c2b-9c2d28f7fae6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.797387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:50.814561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.815172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.815457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.815733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.816507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] RBAC: Adding query filter params (role.id=5b5518e8da0949ae9f1215f2739e508b, scope.project.id=2b250bd3cd9c486d9bbb5598a494cad0, user.id=d8f8c179d1464c7c9b321899a46d8739) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:50.816821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.818818 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.823554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:50.824370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:50.824690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 60/124] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:15:50 2022] GET /identity/v3/role_assignments?user.id=d8f8c179d1464c7c9b321899a46d8739&scope.project.id=2b250bd3cd9c486d9bbb5598a494cad0&role.id=5b5518e8da0949ae9f1215f2739e508b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:50.824958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:50.825617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:50.825736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.833171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:50.835879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:50.838990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 65/125] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:50 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:50.845056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:50.966199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa1c3e-c7b8-44f5-bc6c-1069e910b3eb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:50.983295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd216-53f7-4988-bf2b-b282f93dcbd3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:51.008867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:51.009781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:51.010794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:51.011396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:51.022487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:51.023152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:51.023435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:51.023708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/dfcf1ac07172414b8daec317b5f09719/roles/2e908cd6639c4af582e0f1588a2e1258` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:51.026716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] RBAC: Authorizing `identity:create_grant(project_id=a026f5fdee4d46e8bc11a247752d347e, user_id=dfcf1ac07172414b8daec317b5f09719, role_id=2e908cd6639c4af582e0f1588a2e1258)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:51.028233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:51.047994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 66/126] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:15:50 2022] PUT /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e/users/dfcf1ac07172414b8daec317b5f09719/roles/2e908cd6639c4af582e0f1588a2e1258 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:15:51.073889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:51.097075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:51.098560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:51.213860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 61/127] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:15:51.219464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:51.232123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:51.326410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a678f-c456-47d3-ad8d-5e4d34ba412f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:51.360968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049597d-8d2c-4de9-a1fb-13377ae0d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:51.361594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049597d-8d2c-4de9-a1fb-13377ae0d488 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:51.361874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049597d-8d2c-4de9-a1fb-13377ae0d488 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:51.362144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049597d-8d2c-4de9-a1fb-13377ae0d488 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:51.363251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049597d-8d2c-4de9-a1fb-13377ae0d488 None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:51.364756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049597d-8d2c-4de9-a1fb-13377ae0d488 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:51.366550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 67/128] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:51 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:51.372238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:51.454894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:51.474112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4262b-c00d-49f3-a3e1-8b8d6a27f8e8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:51.507475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07100864-974e-4492-96d1-124f82369f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:51.508203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07100864-974e-4492-96d1-124f82369f7e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:51.508555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07100864-974e-4492-96d1-124f82369f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:51.508897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07100864-974e-4492-96d1-124f82369f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:51.509700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07100864-974e-4492-96d1-124f82369f7e None admin] RBAC: Adding query filter params (role.id=1aeee7a88610411d8ff149cc0528f706, scope.project.id=a026f5fdee4d46e8bc11a247752d347e, user.id=d8f8c179d1464c7c9b321899a46d8739) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:51.510081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07100864-974e-4492-96d1-124f82369f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:51.511588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07100864-974e-4492-96d1-124f82369f7e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:51.517799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 62/129] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:15:51 2022] GET /identity/v3/role_assignments?user.id=d8f8c179d1464c7c9b321899a46d8739&scope.project.id=a026f5fdee4d46e8bc11a247752d347e&role.id=1aeee7a88610411d8ff149cc0528f706 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:52.705356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384acde-1dc2-4dff-a481-cbc6533017e2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:52.705875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384acde-1dc2-4dff-a481-cbc6533017e2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:52.706071 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384acde-1dc2-4dff-a481-cbc6533017e2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:52.707379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 68/130] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:52.713955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0b78-ca68-49ff-8cfe-48ba58f9d64d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:52.714373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0b78-ca68-49ff-8cfe-48ba58f9d64d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:52.714629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe0b78-ca68-49ff-8cfe-48ba58f9d64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:52.733408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c8fe0b78-ca68-49ff-8cfe-48ba58f9d64d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:52.734581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c8fe0b78-ca68-49ff-8cfe-48ba58f9d64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:52.800238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 63/131] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:53.066673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384acde-1dc2-4dff-a481-cbc6533017e2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:53.145468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:53.168733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384acde-1dc2-4dff-a481-cbc6533017e2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:53.189510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca330-2048-400a-a958-d66bf73bc665 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:53.189806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca330-2048-400a-a958-d66bf73bc665 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:53.190083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca330-2048-400a-a958-d66bf73bc665 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:53.191431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 64/132] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:15:53.196379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1375-d347-4bbc-9093-01cf9e525b92 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:53.196752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1375-d347-4bbc-9093-01cf9e525b92 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:53.197097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1375-d347-4bbc-9093-01cf9e525b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:53.202176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:53.202806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:53.203093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:53.203375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:53.204492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:53.205933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:53.207494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 69/133] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:53.212954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:53.214960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-942d1375-d347-4bbc-9093-01cf9e525b92 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:53.216229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-942d1375-d347-4bbc-9093-01cf9e525b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:53.281648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 65/134] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:53.309258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1185-6676-4ca3-9887-2a4606eba892 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:53.341438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:53.341974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:53.342258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:53.342532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:53.343180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:53.344648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:53.361960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:53.367117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 70/135] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:15:53 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:15:53.551512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1375-d347-4bbc-9093-01cf9e525b92 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:53.560552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:53.654462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1375-d347-4bbc-9093-01cf9e525b92 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:53.693493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:53.694364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:53.694788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:53.695260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:53.706524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:53.711526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:53.712402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:53.713232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 66/136] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:53.718561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:53.834703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc946e-b715-4f17-b5c7-44dbc215344f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:53.869133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:53.869760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:53.870040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:53.870315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:53.870986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:53.871292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:53.872700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:53.881991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 71/137] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:15:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:53.887783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:53.963120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:53.999315 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750f89-56ce-4d45-a185-9a2d2b96c484 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:54.034517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:54.035193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:54.035473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:54.035745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] PATH_INFO: `/v3/users/dfcf1ac07172414b8daec317b5f09719` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:54.037008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] RBAC: Authorizing `identity:get_user(user_id=dfcf1ac07172414b8daec317b5f09719)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:54.038488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:54.040332 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 67/138] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:53 2022] GET /identity/v3/users/dfcf1ac07172414b8daec317b5f09719 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:54.045891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:54.110792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:54.152024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1161eae-aff8-4b74-b709-306b03e3b245 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:54.188372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:54.188989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:54.189275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:54.189550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:54.259139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:54.260666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:54.324927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:54.361705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 72/139] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:15:54.367866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:54.470017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e184d-3a3b-438e-a4d3-6812efdebd33 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:54.509697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575ff98-3ae8-4d56-b3ab-12209ba953df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:54.510690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575ff98-3ae8-4d56-b3ab-12209ba953df None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:54.511178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575ff98-3ae8-4d56-b3ab-12209ba953df None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:54.511675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575ff98-3ae8-4d56-b3ab-12209ba953df None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:54.513267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575ff98-3ae8-4d56-b3ab-12209ba953df None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:54.514994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575ff98-3ae8-4d56-b3ab-12209ba953df None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:54.517407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 68/140] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:54 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:54.522887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:54.626801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349693-f1ce-4a07-93d1-f49e1c917a67 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:54.660841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c7b45-f73f-49b6-b6d9-42cda69e7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:54.661451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c7b45-f73f-49b6-b6d9-42cda69e7589 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:54.662241 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c7b45-f73f-49b6-b6d9-42cda69e7589 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:54.662529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c7b45-f73f-49b6-b6d9-42cda69e7589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:54.663261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c7b45-f73f-49b6-b6d9-42cda69e7589 None admin] RBAC: Adding query filter params (role.id=2e908cd6639c4af582e0f1588a2e1258, scope.project.id=a026f5fdee4d46e8bc11a247752d347e, user.id=dfcf1ac07172414b8daec317b5f09719) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:54.663567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c7b45-f73f-49b6-b6d9-42cda69e7589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:54.665048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c7b45-f73f-49b6-b6d9-42cda69e7589 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:54.670981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 73/141] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:15:54 2022] GET /identity/v3/role_assignments?user.id=dfcf1ac07172414b8daec317b5f09719&scope.project.id=a026f5fdee4d46e8bc11a247752d347e&role.id=2e908cd6639c4af582e0f1588a2e1258 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:55.664221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a34af-4658-4321-a284-429880428a61 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:55.664828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a34af-4658-4321-a284-429880428a61 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:55.664828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a34af-4658-4321-a284-429880428a61 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:55.666154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 69/142] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:55.671152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58a27-8086-4c29-8b5a-6c33eb6031f3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:55.671605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58a27-8086-4c29-8b5a-6c33eb6031f3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:55.671687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58a27-8086-4c29-8b5a-6c33eb6031f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:55.691441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1bc58a27-8086-4c29-8b5a-6c33eb6031f3 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:55.692687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1bc58a27-8086-4c29-8b5a-6c33eb6031f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:55.717546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:55.769359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 74/143] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:55.807841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82d43-69ff-4e4f-905e-6533b3a5bb0c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:55.808198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82d43-69ff-4e4f-905e-6533b3a5bb0c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:55.808547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82d43-69ff-4e4f-905e-6533b3a5bb0c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:55.810026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 70/144] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:55.815822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79991-f949-4b13-87dd-7e6ac14058e0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:55.816125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79991-f949-4b13-87dd-7e6ac14058e0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:55.816404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79991-f949-4b13-87dd-7e6ac14058e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:55.835285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9ad79991-f949-4b13-87dd-7e6ac14058e0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:55.836503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9ad79991-f949-4b13-87dd-7e6ac14058e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:55.903974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba01ef-f4ac-43de-9666-22f1eb1a25d8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:55.904267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba01ef-f4ac-43de-9666-22f1eb1a25d8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:55.904552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba01ef-f4ac-43de-9666-22f1eb1a25d8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:55.905903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 71/145] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:15:55.912297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 75/146] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:55.912429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae7cc1-d4a5-453c-962f-cd1e34fea1a0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:55.912429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae7cc1-d4a5-453c-962f-cd1e34fea1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:55.912429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae7cc1-d4a5-453c-962f-cd1e34fea1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:55.918023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:55.930415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-61ae7cc1-d4a5-453c-962f-cd1e34fea1a0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:55.931613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-61ae7cc1-d4a5-453c-962f-cd1e34fea1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:55.998192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 72/147] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:56.039886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79991-f949-4b13-87dd-7e6ac14058e0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.125542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:56.141162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79991-f949-4b13-87dd-7e6ac14058e0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.174120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.174684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.174965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.175234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.183633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae7cc1-d4a5-453c-962f-cd1e34fea1a0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.185748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:56.190612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:56.191495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:56.192489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 76/148] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:56.198885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.286019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae7cc1-d4a5-453c-962f-cd1e34fea1a0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.298311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ee27f-81c7-40af-8dfc-b93d98ce24e3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.315582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:56.320796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.321434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.321714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.321989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.331285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.331905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.332187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.332458 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.332545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:56.333117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:56.333418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.335330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:56.337942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:56.338884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:56.339679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 73/149] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:15:56.340488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.347424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 77/150] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:56.349064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.360212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:56.442370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d0a00-3175-411e-9f5c-66248b96553e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.447007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c7af-db3d-40e7-9a52-f323d7e6425b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.478012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.478858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.479138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.479410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.480531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.481210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.481807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.481987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.482080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.482354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.483011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:56.483314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.483550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 74/151] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:56.484342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.489039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.497040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 78/152] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:56.497964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.548008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:56.563183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:56.589154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc14d9-ddc3-4ac7-b396-0aa0f572364f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.593612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d6223-ccc0-4fc9-80ff-34941b3f4a03 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.622232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.622860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.623142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.623416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] PATH_INFO: `/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.626649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.627249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.627532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.627826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.628491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.629928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.636601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] RBAC: Authorizing `identity:get_user(user_id=021bdad8ae3d45069c9cd3fcac5c16d0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.638078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.639888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 75/153] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:56.644960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.659903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 79/154] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:15:56 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:56.659903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.769465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7f27d-a6da-41fb-b70e-160f4e9955cb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.770564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fad7e-82a0-4981-88fe-dcdbb26332fa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.795717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:56.800142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:56.812492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.813139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.813426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.813702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.814840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.815365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.816026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.816310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.816411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.816586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] PATH_INFO: `/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.819331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] RBAC: Authorizing `identity:get_user(user_id=021bdad8ae3d45069c9cd3fcac5c16d0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.819444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 80/155] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:56.819861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.826084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 76/156] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:56.826214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.827038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:56.932601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919ad4-0c68-41c7-bb7a-ddf86cdb20f0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.938300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343f43-076e-4962-9158-c1371a1ab518 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:56.973843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db3e35-6d93-48ed-82f1-d2e67618328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.974664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db3e35-6d93-48ed-82f1-d2e67618328b None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.974944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db3e35-6d93-48ed-82f1-d2e67618328b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.975216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db3e35-6d93-48ed-82f1-d2e67618328b None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/021bdad8ae3d45069c9cd3fcac5c16d0/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.977171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db3e35-6d93-48ed-82f1-d2e67618328b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b73fc2052414f9e9b362f20d9968b50, user_id=021bdad8ae3d45069c9cd3fcac5c16d0, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.978613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db3e35-6d93-48ed-82f1-d2e67618328b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.982088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:56.983389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:56.983389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:56.983389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:56.984673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:56.986151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:56.987828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 77/157] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:15:56 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:56.994546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 81/158] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:15:56 2022] PUT /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/021bdad8ae3d45069c9cd3fcac5c16d0/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:15:56.995199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:57.063631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:57.117930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d4a2-ac4c-49c1-ba8c-654e769a9068 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:57.157651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65e94c-0e9d-46a6-867f-353afbe71351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:57.158337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65e94c-0e9d-46a6-867f-353afbe71351 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:57.158654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65e94c-0e9d-46a6-867f-353afbe71351 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:57.158947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65e94c-0e9d-46a6-867f-353afbe71351 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/021bdad8ae3d45069c9cd3fcac5c16d0/roles/1aeee7a88610411d8ff149cc0528f706` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:57.161335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65e94c-0e9d-46a6-867f-353afbe71351 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b73fc2052414f9e9b362f20d9968b50, user_id=021bdad8ae3d45069c9cd3fcac5c16d0, role_id=1aeee7a88610411d8ff149cc0528f706)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:57.162871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65e94c-0e9d-46a6-867f-353afbe71351 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:57.178645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 78/159] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:15:56 2022] PUT /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/021bdad8ae3d45069c9cd3fcac5c16d0/roles/1aeee7a88610411d8ff149cc0528f706 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:15:58.935517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ff8-473e-445e-814a-bbc4a6018d54 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:58.936471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ff8-473e-445e-814a-bbc4a6018d54 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:58.936933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ff8-473e-445e-814a-bbc4a6018d54 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:58.938713 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 82/160] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:58.944764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcff0f-ae68-4355-a53f-15832b84ae00 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:58.945570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcff0f-ae68-4355-a53f-15832b84ae00 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:58.946051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcff0f-ae68-4355-a53f-15832b84ae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:58.966619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5ebcff0f-ae68-4355-a53f-15832b84ae00 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:58.968230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5ebcff0f-ae68-4355-a53f-15832b84ae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:59.043741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 79/161] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:59.089362 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dc268-733e-4b57-8847-bdb08af987ea None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.089982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dc268-733e-4b57-8847-bdb08af987ea None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.090467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dc268-733e-4b57-8847-bdb08af987ea None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.092068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 83/162] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:59.101177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4613-f00d-4092-936b-07082d47414a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.101468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4613-f00d-4092-936b-07082d47414a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.104562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4613-f00d-4092-936b-07082d47414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.122298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-367f4613-f00d-4092-936b-07082d47414a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:59.123531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-367f4613-f00d-4092-936b-07082d47414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:59.167159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:59.196407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 80/163] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:59.235764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd9c0-2716-42d4-8683-301ab8015829 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.236070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd9c0-2716-42d4-8683-301ab8015829 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.236351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd9c0-2716-42d4-8683-301ab8015829 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.237747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 84/164] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:15:59.244342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681ec94-82de-4cbf-a29a-a6f614bfd885 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.244874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681ec94-82de-4cbf-a29a-a6f614bfd885 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.245288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681ec94-82de-4cbf-a29a-a6f614bfd885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.265571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a681ec94-82de-4cbf-a29a-a6f614bfd885 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:59.267054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a681ec94-82de-4cbf-a29a-a6f614bfd885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:59.319639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd9c0-2716-42d4-8683-301ab8015829 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:59.341850 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 81/165] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:15:59.367277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b8258-23a6-4092-b2d9-10fb356e9239 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.367640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b8258-23a6-4092-b2d9-10fb356e9239 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.367964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b8258-23a6-4092-b2d9-10fb356e9239 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.369360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 82/166] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:15:59.375029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c238b-3832-49ee-8cab-0978b95a5b6e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.375304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c238b-3832-49ee-8cab-0978b95a5b6e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.375632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c238b-3832-49ee-8cab-0978b95a5b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.386483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:59.396361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-364c238b-3832-49ee-8cab-0978b95a5b6e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:15:59.398342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-364c238b-3832-49ee-8cab-0978b95a5b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:15:59.438386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd9c0-2716-42d4-8683-301ab8015829 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:59.476511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 83/167] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:15:59.486635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:59.487266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.487540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.487834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.498737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:59.500717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c238b-3832-49ee-8cab-0978b95a5b6e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:59.511809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:59.512721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:15:59.513586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 85/168] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:15:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:15:59.519724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:59.542148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:59.614884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c238b-3832-49ee-8cab-0978b95a5b6e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:59.629370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bf079-b214-4cd8-accc-5e7c891213c9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:59.646038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:59.659147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:59.659781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.660095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.660366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.661465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:59.663467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:59.665151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 84/169] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:15:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:15:59.665982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:59.669508 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:59.670321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.670777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.671225 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.672120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:15:59.672597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:59.674163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:59.683302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 86/170] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:15:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:15:59.684296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:59.780003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367133d-15a2-440a-a519-bc2c4cb6c1a3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:59.781525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:59.795114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be66668-3a05-48ca-9e94-7013cc810415 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:59.816003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:59.816625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.816903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.817172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.827446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:15:59.828042 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:59.828642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.828926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.829201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:15:59.829853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:15:59.831295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:15:59.832214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:15:59.833237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:15:59.834097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 85/171] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:15:59.834752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:59.854589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 87/172] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:15:59 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:15:59.855984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:15:59.897226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:15:59.960713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe0924-2cf9-4322-ad1b-e07ca565a1b1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:59.978083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ad398-9e18-4b89-b6bf-fe76137ef092 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:15:59.998630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:15:59.999278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:15:59.999556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:15:59.999852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] PATH_INFO: `/v3/users/4b0e04f42fc24c059294a68943f1b69f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.014831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] RBAC: Authorizing `identity:get_user(user_id=4b0e04f42fc24c059294a68943f1b69f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.016433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.018149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 86/173] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:15:59 2022] GET /identity/v3/users/4b0e04f42fc24c059294a68943f1b69f => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:00.018295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.018934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.019299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.019712 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.020147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.034839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:00.040377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:00.042178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 88/174] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:00.042979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.049582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:00.149909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb8f0-2c20-4862-ab65-e41b36e8e47e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.161861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:00.174809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9135e-001f-42db-b183-59253cb74d70 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.196419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.197034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.197316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.197590 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.198262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:00.198565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.199964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.210046 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 87/175] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:00.213535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.227444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.229763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.230043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.230314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.232294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.234003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.235581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 89/176] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:00.236301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.317441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:00.339371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931472-278f-4f56-bb73-4599062f91d5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.368941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177c2c3-d727-4337-9dbb-ee875c068c24 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.377533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.378148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.378429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.378703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.379727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:00.379727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.381675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.391353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 88/177] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:00.392207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.416079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.417034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.418055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.418550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] PATH_INFO: `/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.420489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] RBAC: Authorizing `identity:get_user(user_id=021bdad8ae3d45069c9cd3fcac5c16d0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.422885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.425739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 90/178] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:00.426745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.465358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:00.515263 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20479ea0-4412-4ee5-a982-5401a0440ae4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.561748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.562411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.562693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.562959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/4b0e04f42fc24c059294a68943f1b69f/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.565927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b73fc2052414f9e9b362f20d9968b50, user_id=4b0e04f42fc24c059294a68943f1b69f, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.567365 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa753a2-79e9-4425-b828-7e0bc57f7f5b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.567940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.587535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 89/179] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:00 2022] PUT /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/4b0e04f42fc24c059294a68943f1b69f/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:00.588855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.594964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:00.608920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.609628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.609960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.610236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] PATH_INFO: `/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.611488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] RBAC: Authorizing `identity:get_user(user_id=021bdad8ae3d45069c9cd3fcac5c16d0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.613363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.615958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 91/180] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/users/021bdad8ae3d45069c9cd3fcac5c16d0 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:00.626039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.722768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbcdd2-3263-4678-80c5-d3a0481551a8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.765135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.766154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.766711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.767923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.859891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:00.862468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.865595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:00.866825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ef59f-33ef-488b-9592-4863633eede5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:00.869783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:00.913282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:00.914083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:00.914471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:00.914890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:00.992796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 90/181] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:00.997384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:00.998708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:00.999625 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:01.098499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:01.106042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79032cf8-601e-4530-98e3-f8726a2e610b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:01.107306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 92/182] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:01.114091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:01.114929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:01.142648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:01.143443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:01.143937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:01.144224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:01.149429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:01.149429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:01.149429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 91/183] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:00 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:01.156627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:01.266988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b85c55-1eeb-4edd-9266-186de8dd1d96 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:01.305621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12d3a4-6d8c-4c6e-813d-ba3580546285 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:01.314008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:01.314644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:01.314901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:01.315183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:01.315952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=2b73fc2052414f9e9b362f20d9968b50, user.id=021bdad8ae3d45069c9cd3fcac5c16d0) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:01.316268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:01.317707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:01.324457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 92/184] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:01 2022] GET /identity/v3/role_assignments?user.id=021bdad8ae3d45069c9cd3fcac5c16d0&scope.project.id=2b73fc2052414f9e9b362f20d9968b50&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:01.384828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94044393-2b89-4950-8635-b00be4928059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:01.385491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044393-2b89-4950-8635-b00be4928059 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:01.385773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044393-2b89-4950-8635-b00be4928059 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:01.386046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044393-2b89-4950-8635-b00be4928059 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:01.387290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044393-2b89-4950-8635-b00be4928059 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:01.388831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044393-2b89-4950-8635-b00be4928059 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:01.390962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 93/185] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:01 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:01.397276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:01.446288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:01.516626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac83c-2e39-484e-b0da-20f1bce7370f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:01.563987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363376dd-9f4d-4e03-82f4-aa675c007bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:01.564558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363376dd-9f4d-4e03-82f4-aa675c007bbd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:01.564848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363376dd-9f4d-4e03-82f4-aa675c007bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:01.565119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363376dd-9f4d-4e03-82f4-aa675c007bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:01.565864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363376dd-9f4d-4e03-82f4-aa675c007bbd None admin] RBAC: Adding query filter params (role.id=1aeee7a88610411d8ff149cc0528f706, scope.project.id=2b73fc2052414f9e9b362f20d9968b50, user.id=021bdad8ae3d45069c9cd3fcac5c16d0) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:01.566173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363376dd-9f4d-4e03-82f4-aa675c007bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:01.567611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363376dd-9f4d-4e03-82f4-aa675c007bbd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:01.578845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 93/186] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:01 2022] GET /identity/v3/role_assignments?user.id=021bdad8ae3d45069c9cd3fcac5c16d0&scope.project.id=2b73fc2052414f9e9b362f20d9968b50&role.id=1aeee7a88610411d8ff149cc0528f706 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:02.320427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6baa69-324c-4057-8e2f-e980a9139a1b None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:02.320973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6baa69-324c-4057-8e2f-e980a9139a1b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:02.320973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6baa69-324c-4057-8e2f-e980a9139a1b None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:02.322586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 94/187] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:02.327871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7765-cf3f-4fd4-aea0-be8f917fd1f4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:02.328253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7765-cf3f-4fd4-aea0-be8f917fd1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:02.328443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7765-cf3f-4fd4-aea0-be8f917fd1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:02.346800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e3ec7765-cf3f-4fd4-aea0-be8f917fd1f4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:02.348000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e3ec7765-cf3f-4fd4-aea0-be8f917fd1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:02.358976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec33d7-a54d-47f7-a5fd-746e602649be None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:02.359269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec33d7-a54d-47f7-a5fd-746e602649be None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:02.359553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec33d7-a54d-47f7-a5fd-746e602649be None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:02.360936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 95/188] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:02.365788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4dcae-7d17-4324-bc05-dd41c4c78b65 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:02.366075 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4dcae-7d17-4324-bc05-dd41c4c78b65 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:02.366349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4dcae-7d17-4324-bc05-dd41c4c78b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:02.383903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-84a4dcae-7d17-4324-bc05-dd41c4c78b65 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:02.385075 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-84a4dcae-7d17-4324-bc05-dd41c4c78b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:02.419375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 94/189] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:02.448175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:02.458407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 96/190] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:02.688209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec7765-cf3f-4fd4-aea0-be8f917fd1f4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:02.719996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:02.723663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4dcae-7d17-4324-bc05-dd41c4c78b65 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:02.795331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec7765-cf3f-4fd4-aea0-be8f917fd1f4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:02.830415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:02.831047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:02.831330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:02.831604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:02.834358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4dcae-7d17-4324-bc05-dd41c4c78b65 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:02.843051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:02.847878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:02.848773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:02.849578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 95/191] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:02.854736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:02.871929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:02.872566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:02.872846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:02.873120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:02.874223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:02.875673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:02.877428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 97/192] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:02.883187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:02.943084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:02.955954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:02.968562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704913b6-7fb6-47d0-8af9-b31bda1963f0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:02.983710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52624ef-c9b4-4b72-bf32-ec46bc285e90 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:03.007854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:03.008205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.008484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.008853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.009413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:03.009711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:03.011092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:03.018474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f266-8fb3-4e8a-b558-4b4623031674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:03.019075 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f266-8fb3-4e8a-b558-4b4623031674 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.019354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f266-8fb3-4e8a-b558-4b4623031674 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.019852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f266-8fb3-4e8a-b558-4b4623031674 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.019961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 96/193] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:03.024699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f266-8fb3-4e8a-b558-4b4623031674 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:03.025570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:03.026213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f266-8fb3-4e8a-b558-4b4623031674 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:03.051081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 98/194] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:02 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:16:03.139879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9f7ab-139a-4186-9d6b-cafb3a56ead8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:03.155850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd08ca-a969-4366-a266-09449a3b1acb None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.156141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd08ca-a969-4366-a266-09449a3b1acb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.156414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd08ca-a969-4366-a266-09449a3b1acb None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.157917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 99/195] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:16:03.163328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f685-bba6-4449-9d21-93955e12764f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.163613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f685-bba6-4449-9d21-93955e12764f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.163932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2f685-bba6-4449-9d21-93955e12764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.176470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:03.177114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.177393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.177668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] PATH_INFO: `/v3/users/512354606734445c899c98d96520f3b1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.182851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0ac2f685-bba6-4449-9d21-93955e12764f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:03.184123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0ac2f685-bba6-4449-9d21-93955e12764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:03.194833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] RBAC: Authorizing `identity:get_user(user_id=512354606734445c899c98d96520f3b1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:03.197001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:03.199233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 97/196] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:03 2022] GET /identity/v3/users/512354606734445c899c98d96520f3b1 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:03.204821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:03.218764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:03.263387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 100/197] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:03.322414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a14d8-24c6-4330-806c-4d83990a218c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:03.357661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:03.358273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.358564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.358836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.359999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:03.361542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:03.363120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 98/198] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:03 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:03.369015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2f685-bba6-4449-9d21-93955e12764f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:03.423203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:03.479672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2f685-bba6-4449-9d21-93955e12764f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:03.515132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:03.515816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.516098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.516370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/512354606734445c899c98d96520f3b1/roles/2e908cd6639c4af582e0f1588a2e1258` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.518274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b73fc2052414f9e9b362f20d9968b50, user_id=512354606734445c899c98d96520f3b1, role_id=2e908cd6639c4af582e0f1588a2e1258)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:03.519707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:03.533651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 101/199] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:03 2022] PUT /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50/users/512354606734445c899c98d96520f3b1/roles/2e908cd6639c4af582e0f1588a2e1258 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:03.534665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:03.633642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:03.658639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a1cf-5dc6-499a-bedb-80089d837e7d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:03.697177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:03.697830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.698111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.698383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.710871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:03.715911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:03.716798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:03.717592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 99/200] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:03.722822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:03.841475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7693c8-3783-440b-90a3-ef707a5aa18b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:03.850680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:03.877469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:03.878087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:03.878368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:03.878642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:03.879310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:03.879615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:03.881658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:03.890455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 102/201] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:03.896003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:04.004734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a2789-26a1-4cc9-9fb5-0933bbba460a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:04.040233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:04.040835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:04.041112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:04.041383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] PATH_INFO: `/v3/users/4b0e04f42fc24c059294a68943f1b69f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:04.042562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] RBAC: Authorizing `identity:get_user(user_id=4b0e04f42fc24c059294a68943f1b69f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:04.044043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:04.045780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 100/202] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:03 2022] GET /identity/v3/users/4b0e04f42fc24c059294a68943f1b69f => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:04.051105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:04.161392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddfe6b-cc05-44aa-8121-d247d3559f9c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:04.197745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:04.198372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:04.198654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:04.198929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:04.243697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:04.269892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:04.271387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:04.371704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 103/203] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:04.376935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:04.400124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:04.491767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa37d2-3e6b-4039-a5c5-fbfcdd36e54e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:04.526570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d50b25-fe22-4eaa-aa33-436345fac6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:04.527196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d50b25-fe22-4eaa-aa33-436345fac6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:04.527474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d50b25-fe22-4eaa-aa33-436345fac6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:04.527742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d50b25-fe22-4eaa-aa33-436345fac6c4 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:04.528899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d50b25-fe22-4eaa-aa33-436345fac6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:04.530337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d50b25-fe22-4eaa-aa33-436345fac6c4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:04.532270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 101/204] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:04 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:04.538835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:04.613459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:04.649161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d747-80cb-410a-be4d-8fc935951690 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:04.683338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622c431-4e10-4660-8e76-758ba77f2d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:04.683975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622c431-4e10-4660-8e76-758ba77f2d74 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:04.684256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622c431-4e10-4660-8e76-758ba77f2d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:04.684528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622c431-4e10-4660-8e76-758ba77f2d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:04.685256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622c431-4e10-4660-8e76-758ba77f2d74 None admin] RBAC: Adding query filter params (role.id=5b5518e8da0949ae9f1215f2739e508b, scope.project.id=2b73fc2052414f9e9b362f20d9968b50, user.id=4b0e04f42fc24c059294a68943f1b69f) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:04.685565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622c431-4e10-4660-8e76-758ba77f2d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:04.687003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622c431-4e10-4660-8e76-758ba77f2d74 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:04.693151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 104/205] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:04 2022] GET /identity/v3/role_assignments?user.id=4b0e04f42fc24c059294a68943f1b69f&scope.project.id=2b73fc2052414f9e9b362f20d9968b50&role.id=5b5518e8da0949ae9f1215f2739e508b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:05.390934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15b644-24e7-4f2b-b1f5-240fec0d72cb None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:05.391456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15b644-24e7-4f2b-b1f5-240fec0d72cb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:05.391456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15b644-24e7-4f2b-b1f5-240fec0d72cb None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:05.393072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 102/206] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:05.399413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae5719-dca5-4d17-b7b2-1b24d79e7faa None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:05.399950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae5719-dca5-4d17-b7b2-1b24d79e7faa None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:05.400022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae5719-dca5-4d17-b7b2-1b24d79e7faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:05.420105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-69ae5719-dca5-4d17-b7b2-1b24d79e7faa None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:05.421327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-69ae5719-dca5-4d17-b7b2-1b24d79e7faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:05.490656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 105/207] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:05.520460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5fc1c-8f8a-44b4-98ed-ae560f639c95 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:05.520749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5fc1c-8f8a-44b4-98ed-ae560f639c95 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:05.521008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5fc1c-8f8a-44b4-98ed-ae560f639c95 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:05.523002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 103/208] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:05.527949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb1f5-9c2d-4de1-aba5-ba8354eeb49e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:05.528239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb1f5-9c2d-4de1-aba5-ba8354eeb49e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:05.528513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb1f5-9c2d-4de1-aba5-ba8354eeb49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:05.546696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-892eb1f5-9c2d-4de1-aba5-ba8354eeb49e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:05.547881 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-892eb1f5-9c2d-4de1-aba5-ba8354eeb49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:05.605425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:05.614867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 106/209] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:05.758072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5fc1c-8f8a-44b4-98ed-ae560f639c95 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:05.766046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ab1a-753b-4291-a1de-89e6cb223cf2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:05.766330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ab1a-753b-4291-a1de-89e6cb223cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:05.766603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ab1a-753b-4291-a1de-89e6cb223cf2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:05.768124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 107/210] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:16:05.773387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28e2f4-0406-421b-a728-d143cda00ce5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:05.773670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28e2f4-0406-421b-a728-d143cda00ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:05.773945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28e2f4-0406-421b-a728-d143cda00ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:05.791610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5c28e2f4-0406-421b-a728-d143cda00ce5 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:05.792801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c28e2f4-0406-421b-a728-d143cda00ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:05.844173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:05.868652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 108/211] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:05.870931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5fc1c-8f8a-44b4-98ed-ae560f639c95 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:05.884001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28e2f4-0406-421b-a728-d143cda00ce5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:05.906983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:05.907603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:05.907907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:05.908180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:05.918427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:05.923193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:05.924169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:05.924993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 104/212] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:05.930408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:05.995781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28e2f4-0406-421b-a728-d143cda00ce5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.020376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:06.030905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.031533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.031922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.032105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.033186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.034711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:06.036297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 109/213] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:06.039236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494b73-1c1d-422f-8e03-28ffc63f57ac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.042414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:06.075828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.077441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.077873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.078290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.079110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:06.079416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.080834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:06.082290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:06.091324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 105/214] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:06.096725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:06.149067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464764b-8c0a-441f-b7aa-f22e040c1a37 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.181599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.182196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.182475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.182744 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.183385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.184847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:06.197294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c2e32-fa2f-42e7-9258-aaac4c98e35f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.205729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 110/215] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:06 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:16:06.206628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:06.246250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.247215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.247525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.247773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] PATH_INFO: `/v3/users/4db59e77546743f7bdc863bb8b8678b9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.261887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:06.265668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] RBAC: Authorizing `identity:get_user(user_id=4db59e77546743f7bdc863bb8b8678b9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.267315 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:06.269555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 106/216] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:06 2022] GET /identity/v3/users/4db59e77546743f7bdc863bb8b8678b9 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:06.275743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:06.324564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe6185-cc21-4d0f-8590-cec49f09ea8d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.339489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:06.361551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.362198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.362494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.362766 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.374297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:06.379583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:06.380534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:06.381375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 111/217] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:06.387249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:06.399404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8adc2-5df1-4cfd-95e0-f75ceec8a744 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.441307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.441789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.442451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.442731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.444361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] RBAC: Adding query filter params (role.id=5b5518e8da0949ae9f1215f2739e508b, user.id=4db59e77546743f7bdc863bb8b8678b9, scope.system=all) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:06.444681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.446127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:06.453805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 107/218] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 12 12:16:06 2022] GET /identity/v3/role_assignments?user.id=4db59e77546743f7bdc863bb8b8678b9&scope.system=all&role.id=5b5518e8da0949ae9f1215f2739e508b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:06.507242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1b9a-c1e5-4621-97fb-32eb4e9417f7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.520289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:06.553347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.554314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.554742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.555160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.556139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:06.556610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.558198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:06.569391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 112/219] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:06.576009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:06.690798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c46faa-4405-4e73-9870-41d50e7477e2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.710558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:06.729510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.730188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.730523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.730801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] PATH_INFO: `/v3/users/512354606734445c899c98d96520f3b1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.731986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] RBAC: Authorizing `identity:get_user(user_id=512354606734445c899c98d96520f3b1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.733537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:06.735528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 108/220] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:06 2022] GET /identity/v3/users/512354606734445c899c98d96520f3b1 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:06.741906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:06.848556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91bae5-4d5e-4c9f-bbac-2c255e0da1ed None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:06.889599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:06.890221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:06.890506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:06.890780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:06.932702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:06.964234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:06.965704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:07.073038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 113/221] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:07.079165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:07.181093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d283-c525-4a3d-8641-124a5070385b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:07.215554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560e32-d56e-484b-a6fb-c0fb01366ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:07.216224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560e32-d56e-484b-a6fb-c0fb01366ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:07.216572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560e32-d56e-484b-a6fb-c0fb01366ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:07.216845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560e32-d56e-484b-a6fb-c0fb01366ce7 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:07.217960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c560e32-d56e-484b-a6fb-c0fb01366ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:07.219405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c560e32-d56e-484b-a6fb-c0fb01366ce7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:07.221081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 109/222] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:07 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:07.227413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:07.302495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:07.338121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd2e9c-a0a0-40bc-8c97-ca4cca6b27f0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:07.372532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60313240-c7c9-47a9-a93f-c4eba4e7e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:07.373131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60313240-c7c9-47a9-a93f-c4eba4e7e01f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:07.373410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60313240-c7c9-47a9-a93f-c4eba4e7e01f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:07.373683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60313240-c7c9-47a9-a93f-c4eba4e7e01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:07.374407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60313240-c7c9-47a9-a93f-c4eba4e7e01f None admin] RBAC: Adding query filter params (role.id=2e908cd6639c4af582e0f1588a2e1258, scope.project.id=2b73fc2052414f9e9b362f20d9968b50, user.id=512354606734445c899c98d96520f3b1) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:07.374712 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60313240-c7c9-47a9-a93f-c4eba4e7e01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:07.376168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60313240-c7c9-47a9-a93f-c4eba4e7e01f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:07.382431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 114/223] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:07 2022] GET /identity/v3/role_assignments?user.id=512354606734445c899c98d96520f3b1&scope.project.id=2b73fc2052414f9e9b362f20d9968b50&role.id=2e908cd6639c4af582e0f1588a2e1258 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:08.565381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccd49e-1dfe-4e8f-8e8b-bff7bda81ee6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:08.565916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccd49e-1dfe-4e8f-8e8b-bff7bda81ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:08.565916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccd49e-1dfe-4e8f-8e8b-bff7bda81ee6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:08.567499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 110/224] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:08.573871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862356-02b1-47c3-b860-cc0a16f75bf0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:08.574376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862356-02b1-47c3-b860-cc0a16f75bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:08.574446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862356-02b1-47c3-b860-cc0a16f75bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:08.582504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4664c-25a6-4193-9878-1d5c91917550 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:08.582796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4664c-25a6-4193-9878-1d5c91917550 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:08.583060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4664c-25a6-4193-9878-1d5c91917550 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:08.584471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 111/225] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:08.590404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355bbae-6d7a-4c69-b6a7-063bf7b62c3b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:08.590706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355bbae-6d7a-4c69-b6a7-063bf7b62c3b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:08.590954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355bbae-6d7a-4c69-b6a7-063bf7b62c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:08.595724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-92862356-02b1-47c3-b860-cc0a16f75bf0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:08.597183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-92862356-02b1-47c3-b860-cc0a16f75bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:08.610672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b355bbae-6d7a-4c69-b6a7-063bf7b62c3b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:08.611882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b355bbae-6d7a-4c69-b6a7-063bf7b62c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:08.664390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:08.669201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 115/226] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:08.684303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 112/227] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:08.685617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571893-3abb-4513-838c-33873d47e2a4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:08.685908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571893-3abb-4513-838c-33873d47e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:08.686181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571893-3abb-4513-838c-33873d47e2a4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:08.687601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 116/228] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:08.695300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872d47-d9cd-4454-981c-dc70cc3b492f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:08.695300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872d47-d9cd-4454-981c-dc70cc3b492f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:08.695300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872d47-d9cd-4454-981c-dc70cc3b492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:08.710911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2c872d47-d9cd-4454-981c-dc70cc3b492f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:08.712111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2c872d47-d9cd-4454-981c-dc70cc3b492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:08.778533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 113/229] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:08.933683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4571893-3abb-4513-838c-33873d47e2a4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:08.973132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872d47-d9cd-4454-981c-dc70cc3b492f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:08.994853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:09.035614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4571893-3abb-4513-838c-33873d47e2a4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.069531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.070153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.070433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.070706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.071819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.073256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.074817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 117/230] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:09.077312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.078720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872d47-d9cd-4454-981c-dc70cc3b492f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.093178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:09.115351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.116372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.116650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.116915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.126798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:09.131918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:09.132807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 114/231] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:09.133741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.179592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bce4b-a141-4005-9a62-8e1c17e12bb2 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.207401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:09.213197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.213892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.214176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.214453 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.224277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:09.230067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:09.231107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:09.231973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 118/232] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:09.232642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.232709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040eb21-2ad2-4409-9e5b-e3207c51f1a3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.266390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.266987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.267265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.267565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] PATH_INFO: `/v3/groups` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.268226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.269672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.285366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 115/233] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Oct 12 12:16:09 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:09.293112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.334239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:09.341481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863f2b-b5ce-434b-ba99-ac25eacb3b96 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.380938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.382100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.382382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.382660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.383340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:09.383645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.385109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.395270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 119/234] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:09.401802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.418390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbaa22-f8b1-4502-9f4a-29ed36856b35 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.455779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.456663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.456948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.457252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.458001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:09.458264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.461128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.469308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:09.472763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 116/235] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:09.479560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.521323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36f8e-bd73-4351-bee9-58229db046ec None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.555167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.555815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.556103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.556375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] PATH_INFO: `/v3/users/e35c4743d43542219433cd88ef31d798` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.570487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] RBAC: Authorizing `identity:get_user(user_id=e35c4743d43542219433cd88ef31d798)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.572047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.573708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 120/236] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:09 2022] GET /identity/v3/users/e35c4743d43542219433cd88ef31d798 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:09.579556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.583433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:09.595253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafb69-59c5-4ede-886a-098c4572a504 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.634720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.635917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.636209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.636485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] PATH_INFO: `/v3/users/4db59e77546743f7bdc863bb8b8678b9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.638128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] RBAC: Authorizing `identity:get_user(user_id=4db59e77546743f7bdc863bb8b8678b9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.640421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.643070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 117/237] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:09 2022] GET /identity/v3/users/4db59e77546743f7bdc863bb8b8678b9 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:09.648817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:09.689228 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a30296-b7ea-460a-a3f7-acf04d386251 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.703648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:09.724961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a7514-a8be-43f9-b28f-873beed564dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.725492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a7514-a8be-43f9-b28f-873beed564dd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.725774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a7514-a8be-43f9-b28f-873beed564dd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.726047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a7514-a8be-43f9-b28f-873beed564dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.726778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a7514-a8be-43f9-b28f-873beed564dd None admin] RBAC: Adding query filter params (role.id=2e908cd6639c4af582e0f1588a2e1258, user.id=e35c4743d43542219433cd88ef31d798, scope.system=all) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:09.727085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a7514-a8be-43f9-b28f-873beed564dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.728546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a7514-a8be-43f9-b28f-873beed564dd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.735830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 121/238] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 12 12:16:09 2022] GET /identity/v3/role_assignments?user.id=e35c4743d43542219433cd88ef31d798&scope.system=all&role.id=2e908cd6639c4af582e0f1588a2e1258 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:09.766919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48afe2-0acd-4cd8-9a39-822b0166c640 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:09.806609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3ee4-5d6b-417a-86f9-f45a69cb58ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:09.807290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3ee4-5d6b-417a-86f9-f45a69cb58ab None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:09.807572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3ee4-5d6b-417a-86f9-f45a69cb58ab None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:09.807952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3ee4-5d6b-417a-86f9-f45a69cb58ab None admin] PATH_INFO: `/v3/system/users/4db59e77546743f7bdc863bb8b8678b9/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:09.809465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3ee4-5d6b-417a-86f9-f45a69cb58ab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4db59e77546743f7bdc863bb8b8678b9, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:09.810872 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3ee4-5d6b-417a-86f9-f45a69cb58ab None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:09.822724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 118/239] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Oct 12 12:16:09 2022] PUT /identity/v3/system/users/4db59e77546743f7bdc863bb8b8678b9/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:16:11.547389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979fe7-544d-4166-9c6e-44094e46da0c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:11.548151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979fe7-544d-4166-9c6e-44094e46da0c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:11.548151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979fe7-544d-4166-9c6e-44094e46da0c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:11.549354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 122/240] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:11.554949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0844c-fd81-49ad-b078-81364e4db1fe None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:11.555346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0844c-fd81-49ad-b078-81364e4db1fe None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:11.555505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0844c-fd81-49ad-b078-81364e4db1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:11.574032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-98e0844c-fd81-49ad-b078-81364e4db1fe None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:11.575192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-98e0844c-fd81-49ad-b078-81364e4db1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:11.598902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:11.647119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 119/241] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:11.873522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f35b-2df0-4be7-9542-977c7d96ef6e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:11.873849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f35b-2df0-4be7-9542-977c7d96ef6e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:11.874079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6f35b-2df0-4be7-9542-977c7d96ef6e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:11.875417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 123/242] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:11.880722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b78ea-e218-449c-976a-bcfe99ac5315 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:11.881011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b78ea-e218-449c-976a-bcfe99ac5315 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:11.881281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b78ea-e218-449c-976a-bcfe99ac5315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:11.899285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d36b78ea-e218-449c-976a-bcfe99ac5315 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:11.900465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d36b78ea-e218-449c-976a-bcfe99ac5315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:11.917050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f35b-2df0-4be7-9542-977c7d96ef6e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:11.972006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 120/243] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:11.973245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f7c59-fdbd-4fd8-b462-c468d3561a00 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:11.973534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f7c59-fdbd-4fd8-b462-c468d3561a00 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:11.973801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f7c59-fdbd-4fd8-b462-c468d3561a00 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:11.975037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 121/244] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:11.981584 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916d19-60a0-4fc1-b902-2132fc6cec13 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:11.981921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916d19-60a0-4fc1-b902-2132fc6cec13 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:11.982240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916d19-60a0-4fc1-b902-2132fc6cec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.000482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6f916d19-60a0-4fc1-b902-2132fc6cec13 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:12.001671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6f916d19-60a0-4fc1-b902-2132fc6cec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:12.036504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6f35b-2df0-4be7-9542-977c7d96ef6e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.069390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 122/245] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:12.082210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.082904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.083252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.083591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.085310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:12.086808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:12.088629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 124/246] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:12.093830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f916d19-60a0-4fc1-b902-2132fc6cec13 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.112761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:12.193299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f916d19-60a0-4fc1-b902-2132fc6cec13 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.226543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f719af-6697-48de-92f8-f646da7520db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.227140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f719af-6697-48de-92f8-f646da7520db None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.227415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f719af-6697-48de-92f8-f646da7520db None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.227678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f719af-6697-48de-92f8-f646da7520db None admin] PATH_INFO: `/v3/groups` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.228334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f719af-6697-48de-92f8-f646da7520db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:12.229777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f719af-6697-48de-92f8-f646da7520db None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:12.243770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.246434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 123/247] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Oct 12 12:16:12 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:12.296034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:12.343060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f719af-6697-48de-92f8-f646da7520db None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.358853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb52269-6fdf-41f0-98ac-1895c7c3d3df None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.400565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.401212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.401495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.401772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.412588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:12.418542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:12.419430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:12.420252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 125/248] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:12.426810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.440635 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:12.469168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f719af-6697-48de-92f8-f646da7520db None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.505922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.506558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.507382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.507655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.519598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:12.525866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:12.526766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:12.527557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 124/249] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:12.534033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.547312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcced74-4fcd-49a7-9519-c4cd930f2ee1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.549649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:12.590846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.591724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.592171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.592586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.593421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:12.593868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:12.595427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:12.605765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 126/250] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:12.611989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.670196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f82e-00ee-4420-8bd8-5e2d27c5227e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.714448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.715387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.715920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.716376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.717659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:12.718403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:12.720165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:12.727229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:12.731824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 125/251] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:12.734073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74396cc1-e8fc-4049-abe7-24be2d88b4cc None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.738079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.789970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.790858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.791285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.791703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] PATH_INFO: `/v3/users/e35c4743d43542219433cd88ef31d798` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.793133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] RBAC: Authorizing `identity:get_user(user_id=e35c4743d43542219433cd88ef31d798)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:12.795406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:12.797906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 127/252] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:12 2022] GET /identity/v3/users/e35c4743d43542219433cd88ef31d798 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:12.804528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.849320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:12.865334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e055e4-a9e9-434e-bf6c-2a4f907039ad None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.905293 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.906045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.906396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.906744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] PATH_INFO: `/v3/users/4db59e77546743f7bdc863bb8b8678b9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.908662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] RBAC: Authorizing `identity:get_user(user_id=4db59e77546743f7bdc863bb8b8678b9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:12.909627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:12.912338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 126/253] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:12 2022] GET /identity/v3/users/4db59e77546743f7bdc863bb8b8678b9 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:12.917066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:12.943254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac501078-8af0-4347-8a03-4240cf85684c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:12.980404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cab5e-f23f-4b19-9a57-5cba5eda24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:12.981011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cab5e-f23f-4b19-9a57-5cba5eda24c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:12.981294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cab5e-f23f-4b19-9a57-5cba5eda24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:12.981574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cab5e-f23f-4b19-9a57-5cba5eda24c0 None admin] PATH_INFO: `/v3/system/users/e35c4743d43542219433cd88ef31d798/roles/2e908cd6639c4af582e0f1588a2e1258` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:12.983001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cab5e-f23f-4b19-9a57-5cba5eda24c0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e35c4743d43542219433cd88ef31d798, role_id=2e908cd6639c4af582e0f1588a2e1258)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:12.984420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cab5e-f23f-4b19-9a57-5cba5eda24c0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:12.998075 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 128/254] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Oct 12 12:16:12 2022] PUT /identity/v3/system/users/e35c4743d43542219433cd88ef31d798/roles/2e908cd6639c4af582e0f1588a2e1258 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:13.009987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:13.060362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb9725-762e-4669-bf84-722af6cf2bfe None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:13.100415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e677b0-cf9b-4ba0-bb7b-3cbad1f445bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:13.101613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e677b0-cf9b-4ba0-bb7b-3cbad1f445bd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:13.101902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e677b0-cf9b-4ba0-bb7b-3cbad1f445bd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:13.102172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e677b0-cf9b-4ba0-bb7b-3cbad1f445bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:13.102977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e677b0-cf9b-4ba0-bb7b-3cbad1f445bd None admin] RBAC: Adding query filter params (role.id=5b5518e8da0949ae9f1215f2739e508b, user.id=4db59e77546743f7bdc863bb8b8678b9, scope.system=all) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:13.103288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e677b0-cf9b-4ba0-bb7b-3cbad1f445bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:13.104907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e677b0-cf9b-4ba0-bb7b-3cbad1f445bd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:13.120458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 127/255] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 12 12:16:12 2022] GET /identity/v3/role_assignments?user.id=4db59e77546743f7bdc863bb8b8678b9&scope.system=all&role.id=5b5518e8da0949ae9f1215f2739e508b => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:14.841866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148563d-32a3-4ab1-9e2f-555da94ffb23 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:14.842808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148563d-32a3-4ab1-9e2f-555da94ffb23 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:14.843318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148563d-32a3-4ab1-9e2f-555da94ffb23 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:14.845205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 129/256] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:14.850465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3f3c-99fc-4554-b3ee-54779fd5bcfb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:14.851321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3f3c-99fc-4554-b3ee-54779fd5bcfb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:14.851828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3f3c-99fc-4554-b3ee-54779fd5bcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:14.876025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-523b3f3c-99fc-4554-b3ee-54779fd5bcfb None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:14.877647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-523b3f3c-99fc-4554-b3ee-54779fd5bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:14.955249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 128/257] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:16:15.109312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e59115-d9ad-4062-87ad-df188d9ddba2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.109992 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e59115-d9ad-4062-87ad-df188d9ddba2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.110501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e59115-d9ad-4062-87ad-df188d9ddba2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.112184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 130/258] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:15.117989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cac58-6d36-42ad-9e07-4aeacd60ea77 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.118531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cac58-6d36-42ad-9e07-4aeacd60ea77 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.119018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cac58-6d36-42ad-9e07-4aeacd60ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.145027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3b1cac58-6d36-42ad-9e07-4aeacd60ea77 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:15.146575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3b1cac58-6d36-42ad-9e07-4aeacd60ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:15.158056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 129/259] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:16:15.352061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e59115-d9ad-4062-87ad-df188d9ddba2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.369481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e59115-d9ad-4062-87ad-df188d9ddba2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.374345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.375249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.375726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.376229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.396451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:15.401633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:15.402505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:15.403313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:15.406840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 131/260] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:15.412109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cac58-6d36-42ad-9e07-4aeacd60ea77 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.427270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cac58-6d36-42ad-9e07-4aeacd60ea77 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.435928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.436544 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.436826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.437101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.437787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:15.438092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.439929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:16:15.439929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:16:15.439929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:16:15.440840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.456774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 130/261] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:15.463338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.473490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbe042-7c8b-453a-9acb-123f21c0c870 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.483758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.484637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.485137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.485617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.496900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.498897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:16:15.498897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:16:15.498897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:16:15.500478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.503599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 132/262] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:15.508439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.524913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b907a-3389-404a-90e3-6b5618c4f887 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.533484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.534161 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.534456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.534736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.535746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.535977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.538875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.540731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 131/263] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:15.548309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be89d4-9abf-4adb-ba01-de8b320cd29f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.551995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.560491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.561143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.561424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.561696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.569917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1144b-22e4-42a0-b9bf-7c86882738da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.577595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.578558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.578842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.579361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e/groups/1e8b475bd8204235b2d31657da4a2512/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.581603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a026f5fdee4d46e8bc11a247752d347e, group_id=1e8b475bd8204235b2d31657da4a2512, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.582895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:16:15.582895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:16:15.582895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:16:15.585312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.591850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:15.593652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:15.594763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:15.595733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 133/264] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:15.601291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.610658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 132/265] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 12 12:16:15 2022] PUT /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e/groups/1e8b475bd8204235b2d31657da4a2512/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:16:15.625733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcafb37-fa6a-4b44-bb28-b1a101e03f69 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.713543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.714180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.714461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.714735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.715439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:15.715745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.716813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:16:15.716813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:16:15.716813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:16:15.717746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.728402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 134/266] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:15.734361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.749730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89e3e6-5a6e-4d8f-a8f1-f27c04318338 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.762861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.763952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.764438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.764940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.766393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.767667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:16:15.767667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:16:15.767667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:16:15.769347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.782056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 133/267] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:15.787533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.805595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531cb5-043a-436f-8b56-4061edde0b76 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.816389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e096614-1f0c-498c-8a03-cc8afe2db7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.817051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e096614-1f0c-498c-8a03-cc8afe2db7fe admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.817330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e096614-1f0c-498c-8a03-cc8afe2db7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.817604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e096614-1f0c-498c-8a03-cc8afe2db7fe admin admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.820714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e096614-1f0c-498c-8a03-cc8afe2db7fe admin admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.822918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e096614-1f0c-498c-8a03-cc8afe2db7fe admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.825129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 135/268] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 12 12:16:15 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:15.831411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:15.845570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001a08-7849-4ff1-8ab8-952eef5e96c1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:15.852455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba64c5-5f2e-4735-b0e5-3ae2affe6a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:15.853892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba64c5-5f2e-4735-b0e5-3ae2affe6a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.854427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba64c5-5f2e-4735-b0e5-3ae2affe6a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.854881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba64c5-5f2e-4735-b0e5-3ae2affe6a37 admin admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e/groups/1e8b475bd8204235b2d31657da4a2512/roles/1aeee7a88610411d8ff149cc0528f706` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.857559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba64c5-5f2e-4735-b0e5-3ae2affe6a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a026f5fdee4d46e8bc11a247752d347e, group_id=1e8b475bd8204235b2d31657da4a2512, role_id=1aeee7a88610411d8ff149cc0528f706)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:15.860759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba64c5-5f2e-4735-b0e5-3ae2affe6a37 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:15.882650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd18bf2-18c1-4cb5-ba2b-cab246161bc7 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.883162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd18bf2-18c1-4cb5-ba2b-cab246161bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.883162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd18bf2-18c1-4cb5-ba2b-cab246161bc7 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.884128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 134/269] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 12 12:16:15 2022] PUT /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e/groups/1e8b475bd8204235b2d31657da4a2512/roles/1aeee7a88610411d8ff149cc0528f706 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:15.885808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 136/270] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:16:15.892339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b482-0aea-4764-9f9a-e645d40f743c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:15.892953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b482-0aea-4764-9f9a-e645d40f743c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:15.893418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b482-0aea-4764-9f9a-e645d40f743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:15.916664 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-22a8b482-0aea-4764-9f9a-e645d40f743c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:15.918294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-22a8b482-0aea-4764-9f9a-e645d40f743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:15.941875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:16.005047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db080-4291-4801-a118-606aa92782e3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:16.005334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db080-4291-4801-a118-606aa92782e3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:16.005605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db080-4291-4801-a118-606aa92782e3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:16.007334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 137/271] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:16.009919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 135/272] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:16.027487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504fb9-8068-4c0b-800b-1d4773d26cbe None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:16.027792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504fb9-8068-4c0b-800b-1d4773d26cbe None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:16.028063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504fb9-8068-4c0b-800b-1d4773d26cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:16.045203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:16.061383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-53504fb9-8068-4c0b-800b-1d4773d26cbe None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:16.062594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-53504fb9-8068-4c0b-800b-1d4773d26cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:16.150192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 138/273] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:16:16.383608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8b482-0aea-4764-9f9a-e645d40f743c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:16.501382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8b482-0aea-4764-9f9a-e645d40f743c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:16.542339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:16.542988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:16.543272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:16.543545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:16.572733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:16.578179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:16.579057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:16.579857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 136/274] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:16.587035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53504fb9-8068-4c0b-800b-1d4773d26cbe None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:16.738199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53504fb9-8068-4c0b-800b-1d4773d26cbe None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:16.770053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:16.785921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:16.786249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:16.786500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:16.786773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:16.787448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:16.787748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:16.790343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:16.794222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b88a6-0752-460f-badf-28f2435394a0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:16.802579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:16.804770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 139/275] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:16.805008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:16.805295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:16.805562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:16.812889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:16.837391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:16.839706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:16.844787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:16.845668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:16.846465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 137/276] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 12 12:16:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:16.852246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:16.860884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:16.874236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec826b31-01f5-4327-bb85-95f3f437da61 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:16.892444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:16.893049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:16.893331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:16.893602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:16.894273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:16.894572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:16.896221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:16.915400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 138/277] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:16:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:16.921713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:16.945654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b8e96-0f4d-497d-b14d-e3e179c16fb2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:16.959226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:16.959899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:16.960723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:16.961003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:16.963684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:16.965681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:16.967387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 139/278] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 12 12:16:16 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:16.973206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:16.979881 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84eede0-8070-4c24-9c75-b49c2f5e3a53 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:16.985456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8ae0-29cc-4c77-b849-3777c14a9fd6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.001116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.001751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.002028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.002298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.003510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.007537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:17.009370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 140/279] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 12 12:16:16 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:17.017985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:17.045082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aa620-d71f-4ac1-94b0-819b53aa18a6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.055051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecfc43-cd26-4bdb-a85c-1446a1685f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.055703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecfc43-cd26-4bdb-a85c-1446a1685f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.056011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecfc43-cd26-4bdb-a85c-1446a1685f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.056285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecfc43-cd26-4bdb-a85c-1446a1685f3f admin admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50/groups/1e8b475bd8204235b2d31657da4a2512/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.058862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecfc43-cd26-4bdb-a85c-1446a1685f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b73fc2052414f9e9b362f20d9968b50, group_id=1e8b475bd8204235b2d31657da4a2512, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.062258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.062886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.063159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.063428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] PATH_INFO: `/v3/users/e35c4743d43542219433cd88ef31d798` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.065627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecfc43-cd26-4bdb-a85c-1446a1685f3f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:17.072617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] RBAC: Authorizing `identity:get_user(user_id=e35c4743d43542219433cd88ef31d798)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.074087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:17.075767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 140/280] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:16:16 2022] GET /identity/v3/users/e35c4743d43542219433cd88ef31d798 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:17.082286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:17.098406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 141/281] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 12 12:16:17 2022] PUT /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50/groups/1e8b475bd8204235b2d31657da4a2512/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:17.101474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518379b0-895a-4e43-ab1a-4a3bf7d30d22 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.101756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518379b0-895a-4e43-ab1a-4a3bf7d30d22 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.102028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518379b0-895a-4e43-ab1a-4a3bf7d30d22 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.103357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 142/282] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:17.117944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7ada-0112-40c5-8325-9c27b50ce399 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.118241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7ada-0112-40c5-8325-9c27b50ce399 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.118479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7ada-0112-40c5-8325-9c27b50ce399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.155941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ddfb7ada-0112-40c5-8325-9c27b50ce399 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:17.157173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ddfb7ada-0112-40c5-8325-9c27b50ce399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:17.256420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 143/283] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 12:16:17.270167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:17.300283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d25f4-34d9-4ef5-856a-ac38b4ce51eb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.348784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4513c-f468-40f3-bd66-744f994d84f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.349790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4513c-f468-40f3-bd66-744f994d84f5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.350284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4513c-f468-40f3-bd66-744f994d84f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.350791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4513c-f468-40f3-bd66-744f994d84f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.351758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4513c-f468-40f3-bd66-744f994d84f5 None admin] RBAC: Adding query filter params (role.id=2e908cd6639c4af582e0f1588a2e1258, user.id=e35c4743d43542219433cd88ef31d798, scope.system=all) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:17.352309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4513c-f468-40f3-bd66-744f994d84f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.353987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4513c-f468-40f3-bd66-744f994d84f5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:17.372014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 141/284] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Oct 12 12:16:17 2022] GET /identity/v3/role_assignments?user.id=e35c4743d43542219433cd88ef31d798&scope.system=all&role.id=2e908cd6639c4af582e0f1588a2e1258 => generated 510 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:17.765223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb7ada-0112-40c5-8325-9c27b50ce399 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:17.781859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb7ada-0112-40c5-8325-9c27b50ce399 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.787032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.787674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.787986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.788298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.804831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:17.808202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34a79-016e-4511-aff0-670974b90dae None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.808489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34a79-016e-4511-aff0-670974b90dae None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.808821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34a79-016e-4511-aff0-670974b90dae None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.810440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 142/285] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:17.814268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:17.815149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:17.815992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 144/286] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 12 12:16:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:17.817990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b268-ee65-4471-8723-8cb9e58b79af None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.818404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b268-ee65-4471-8723-8cb9e58b79af None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.819085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b268-ee65-4471-8723-8cb9e58b79af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.825963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:17.840030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3feb8-6261-4782-b3aa-e6029283f809 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.853060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.853674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.853953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.854222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.854896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:17.855200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.856971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:17.860161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f942b268-ee65-4471-8723-8cb9e58b79af None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:17.861683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f942b268-ee65-4471-8723-8cb9e58b79af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:17.870113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 143/287] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 12:16:17.875856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 145/288] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 12 12:16:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:17.881869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942b268-ee65-4471-8723-8cb9e58b79af None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:17.897067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942b268-ee65-4471-8723-8cb9e58b79af None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.907856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.908852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.909330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.909797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.916480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.918657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:17.920528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 144/289] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 12 12:16:17 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:17.926312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:17.941082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842e6e1-0b27-4670-a02a-f3eb41e5aae9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.948615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.949310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.949637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.949917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.951126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.953629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:17.955656 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 146/290] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 12 12:16:17 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:17.961723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:17.976956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bc509-b738-45d8-b241-87283d516658 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:17.987946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:17.989332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:17.989811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:17.990298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50/groups/1e8b475bd8204235b2d31657da4a2512/roles/1aeee7a88610411d8ff149cc0528f706` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:17.996170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b73fc2052414f9e9b362f20d9968b50, group_id=1e8b475bd8204235b2d31657da4a2512, role_id=1aeee7a88610411d8ff149cc0528f706)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:17.997437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:16:17.997437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:16:17.997437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:16:17.999706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:18.018664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 145/291] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 12 12:16:17 2022] PUT /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50/groups/1e8b475bd8204235b2d31657da4a2512/roles/1aeee7a88610411d8ff149cc0528f706 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:18.334785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:18.346052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2336193-dce7-4445-932f-74e16d8a277f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:18.412503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:18.413153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:18.413983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:18.414259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:18.425104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:18.430520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:18.431409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:18.432242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 147/292] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:16:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:18.438951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:18.456108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf1c0c-fc43-4045-a538-1868b684daa1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:18.465546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:18.466497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:18.467023 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:18.467490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:18.468409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:18.468928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:18.470757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:18.486184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 146/293] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 12 12:16:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:18.492233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:18.505893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1936c-c98f-4342-a3b6-3103c1423da0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:18.515511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:18.516177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:18.516462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:18.516740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] PATH_INFO: `/v3/groups/e3f7f48774834bdfa646ebe2bd1754d6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:18.528422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] RBAC: Authorizing `identity:get_group(group_id=e3f7f48774834bdfa646ebe2bd1754d6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:18.530374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:18.532073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 148/294] 10.222.0.45 () {56 vars in 1201 bytes} [Wed Oct 12 12:16:18 2022] GET /identity/v3/groups/e3f7f48774834bdfa646ebe2bd1754d6 => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:18.537756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:18.549725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc7d56-6e8b-498b-9608-1c3dbed84115 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:18.560095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6efdaf-8aef-4626-9958-4ac8bb59b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:18.561045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6efdaf-8aef-4626-9958-4ac8bb59b811 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:18.561534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6efdaf-8aef-4626-9958-4ac8bb59b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:18.562042 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6efdaf-8aef-4626-9958-4ac8bb59b811 admin admin] PATH_INFO: `/v3/projects/3f11c6a9324b4777879eb5cf98ff4596` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:18.568548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6efdaf-8aef-4626-9958-4ac8bb59b811 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f11c6a9324b4777879eb5cf98ff4596)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:18.570808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6efdaf-8aef-4626-9958-4ac8bb59b811 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:18.573254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 147/295] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Oct 12 12:16:18 2022] GET /identity/v3/projects/3f11c6a9324b4777879eb5cf98ff4596 => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:18.578995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:18.593304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d19db9-b129-4445-ad7a-c7a602136b91 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:18.599898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10720317-db87-46a9-b0f0-9836d039f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:18.600558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10720317-db87-46a9-b0f0-9836d039f694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:18.601384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10720317-db87-46a9-b0f0-9836d039f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:18.601639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10720317-db87-46a9-b0f0-9836d039f694 admin admin] PATH_INFO: `/v3/projects/3f11c6a9324b4777879eb5cf98ff4596/groups/e3f7f48774834bdfa646ebe2bd1754d6/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:18.605514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10720317-db87-46a9-b0f0-9836d039f694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f11c6a9324b4777879eb5cf98ff4596, group_id=e3f7f48774834bdfa646ebe2bd1754d6, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:18.608171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10720317-db87-46a9-b0f0-9836d039f694 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:18.631204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 149/296] 10.222.0.45 () {58 vars in 1463 bytes} [Wed Oct 12 12:16:18 2022] PUT /identity/v3/projects/3f11c6a9324b4777879eb5cf98ff4596/groups/e3f7f48774834bdfa646ebe2bd1754d6/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:18.997077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830cacb-4fb8-4d25-914a-fea48e6a5b9f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:18.997553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830cacb-4fb8-4d25-914a-fea48e6a5b9f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:18.997553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830cacb-4fb8-4d25-914a-fea48e6a5b9f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:18.999139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 148/297] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:19.004767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f970-25d2-42c4-bfe6-94af77cdeebf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:19.005206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f970-25d2-42c4-bfe6-94af77cdeebf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:19.005401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f970-25d2-42c4-bfe6-94af77cdeebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:19.028647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1825f970-25d2-42c4-bfe6-94af77cdeebf None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:19.030152 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1825f970-25d2-42c4-bfe6-94af77cdeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:19.039844 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:19.114220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 150/298] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:19.283204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fca9f-73f4-4930-baf7-0b196e9948d2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:19.283821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fca9f-73f4-4930-baf7-0b196e9948d2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:19.284314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fca9f-73f4-4930-baf7-0b196e9948d2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:19.286085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 149/299] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:19.291781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33c26-12cd-4e21-a729-5ea0f4ea35da None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:19.292104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33c26-12cd-4e21-a729-5ea0f4ea35da None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:19.292383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33c26-12cd-4e21-a729-5ea0f4ea35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:19.318762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-12e33c26-12cd-4e21-a729-5ea0f4ea35da None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:19.320511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-12e33c26-12cd-4e21-a729-5ea0f4ea35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:19.401672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 151/300] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:19.569632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fca9f-73f4-4930-baf7-0b196e9948d2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:19.690019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fca9f-73f4-4930-baf7-0b196e9948d2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:19.691740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:19.727551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33c26-12cd-4e21-a729-5ea0f4ea35da None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:19.742291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:19.742944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:19.743224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:19.743495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:19.770735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:19.775751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:19.776626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:19.777417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 150/301] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:16:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:19.786811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:19.871389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:19.936981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33c26-12cd-4e21-a729-5ea0f4ea35da None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:19.987208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfacf8-3d67-406a-a3d4-a023e409a4ae None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:20.008171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.008834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.009117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.009390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.034927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:20.040445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:20.041313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:20.042107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 152/302] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:20.052810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:20.066869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7efc-6580-4151-af81-6bd6c5938219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.068160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7efc-6580-4151-af81-6bd6c5938219 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.068641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7efc-6580-4151-af81-6bd6c5938219 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.069110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7efc-6580-4151-af81-6bd6c5938219 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.070034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7efc-6580-4151-af81-6bd6c5938219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:20.070533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7efc-6580-4151-af81-6bd6c5938219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:20.072155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7efc-6580-4151-af81-6bd6c5938219 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:20.082761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 151/303] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:20.084369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bd1c6-b42e-4644-bc38-63c8f3aa0de3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.084894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bd1c6-b42e-4644-bc38-63c8f3aa0de3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.085400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bd1c6-b42e-4644-bc38-63c8f3aa0de3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.087113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 152/304] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:20.092744 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bd1c6-b42e-4644-bc38-63c8f3aa0de3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:20.127600 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:20.172289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adecc3a-502e-4b4f-951d-48ec1c17873e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:20.208381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:20.215346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0aadb-5482-4e65-b059-bae59a469fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.216019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0aadb-5482-4e65-b059-bae59a469fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.216435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0aadb-5482-4e65-b059-bae59a469fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.216633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0aadb-5482-4e65-b059-bae59a469fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.217803 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0aadb-5482-4e65-b059-bae59a469fd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:20.218333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0aadb-5482-4e65-b059-bae59a469fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:20.220067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bd1c6-b42e-4644-bc38-63c8f3aa0de3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:20.221313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0aadb-5482-4e65-b059-bae59a469fd7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:20.236556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 153/305] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:20.242835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767db1c-5892-4933-b32b-fb9261d1ba0b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.242835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767db1c-5892-4933-b32b-fb9261d1ba0b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.242835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767db1c-5892-4933-b32b-fb9261d1ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.260405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3767db1c-5892-4933-b32b-fb9261d1ba0b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:20.261759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3767db1c-5892-4933-b32b-fb9261d1ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:20.268191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.269061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.269537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.270503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.341186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 154/306] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:20.346979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767db1c-5892-4933-b32b-fb9261d1ba0b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:20.357782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:20.359519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:20.386591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:20.472926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 153/307] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:20.482629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:20.531558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767db1c-5892-4933-b32b-fb9261d1ba0b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:20.563488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:20.578504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.579817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.580546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.581069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.651895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59c065-26e0-4950-8036-b565014a1209 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:20.686639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:20.688496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:20.706368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:20.737042 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.737691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.737976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.738259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.739461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:20.740947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:20.742986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 154/308] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:20 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:20.752536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:20.808515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 155/309] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:20.815265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:20.864183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:20.913292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581050-b1bd-4418-a7f9-337edb59163f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:20.933177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14522634-abec-4161-b5b1-dcfdf1bca15e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:20.989076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.989313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:20.989727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.989828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:20.990008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.990102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:20.990285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] PATH_INFO: `/v3/projects/a026f5fdee4d46e8bc11a247752d347e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.990388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:20.991420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:20.991523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] RBAC: Authorizing `identity:get_project(project_id=a026f5fdee4d46e8bc11a247752d347e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:20.993496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:20.993602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:20.995168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 155/310] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 12 12:16:20 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:20.995585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 156/311] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:20 2022] GET /identity/v3/projects/a026f5fdee4d46e8bc11a247752d347e => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:20.996755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:21.001190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:21.071838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:21.104409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:21.119278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15466d3e-d818-4ce5-b435-bb0dca819200 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:21.123185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5906aba-808a-4cf7-a68b-35c99eb8e81e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:21.162977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:21.164587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.165060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.165339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.166437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:21.167917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574ffc0-b2e1-4511-bd18-5b970f450d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:21.168038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:21.168554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ffc0-b2e1-4511-bd18-5b970f450d3f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.168837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ffc0-b2e1-4511-bd18-5b970f450d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.169113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ffc0-b2e1-4511-bd18-5b970f450d3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.169496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 157/312] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 12 12:16:21 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:21.170257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:21.191922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574ffc0-b2e1-4511-bd18-5b970f450d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a574ffc0-b2e1-4511-bd18-5b970f450d3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:21.199705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:21.200675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:16:21.201491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:21.204454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 156/313] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:21.205945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80331-ec82-4dd6-a1fb-41fe366762fb None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.206460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80331-ec82-4dd6-a1fb-41fe366762fb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.206944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80331-ec82-4dd6-a1fb-41fe366762fb None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.208888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 157/314] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:21.208995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a80331-ec82-4dd6-a1fb-41fe366762fb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:21.304856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebacf3-1597-487d-9e2c-bcee32dd406f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:21.355095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:21.355717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.356065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.356337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.357089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] RBAC: Adding query filter params (group.id=1e8b475bd8204235b2d31657da4a2512, role.id=1aeee7a88610411d8ff149cc0528f706, scope.project.id=a026f5fdee4d46e8bc11a247752d347e) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:21.357403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:21.358873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:21.365552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 158/315] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 12 12:16:21 2022] GET /identity/v3/role_assignments?group.id=1e8b475bd8204235b2d31657da4a2512&scope.project.id=a026f5fdee4d46e8bc11a247752d347e&role.id=1aeee7a88610411d8ff149cc0528f706 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:21.366789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:21.369466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a80331-ec82-4dd6-a1fb-41fe366762fb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:21.398727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:21.406049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:21.422315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa348f5-d45c-49a9-a79b-a207d3316787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:21.422315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa348f5-d45c-49a9-a79b-a207d3316787 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.422645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa348f5-d45c-49a9-a79b-a207d3316787 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.423033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa348f5-d45c-49a9-a79b-a207d3316787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.423888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa348f5-d45c-49a9-a79b-a207d3316787 None admin] RBAC: Adding query filter params (group.id=1e8b475bd8204235b2d31657da4a2512, role.id=5b5518e8da0949ae9f1215f2739e508b, scope.project.id=a026f5fdee4d46e8bc11a247752d347e) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:21.424269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa348f5-d45c-49a9-a79b-a207d3316787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:21.425824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa348f5-d45c-49a9-a79b-a207d3316787 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:21.434512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 158/316] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 12 12:16:21 2022] GET /identity/v3/role_assignments?group.id=1e8b475bd8204235b2d31657da4a2512&scope.project.id=a026f5fdee4d46e8bc11a247752d347e&role.id=5b5518e8da0949ae9f1215f2739e508b => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:21.436143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c58f4-0afd-4d29-9b50-f3218b075f02 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.437019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c58f4-0afd-4d29-9b50-f3218b075f02 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.437453 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c58f4-0afd-4d29-9b50-f3218b075f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.461226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6d8c58f4-0afd-4d29-9b50-f3218b075f02 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:21.463445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6d8c58f4-0afd-4d29-9b50-f3218b075f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:21.516855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90524-803b-45aa-b6e9-1ba8310f0db2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:21.567615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59e160-8c10-4765-9f65-d38d42c524f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:21.568293 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e160-8c10-4765-9f65-d38d42c524f3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.568581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e160-8c10-4765-9f65-d38d42c524f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.568906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e160-8c10-4765-9f65-d38d42c524f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.570745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59e160-8c10-4765-9f65-d38d42c524f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:21.571286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59e160-8c10-4765-9f65-d38d42c524f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:21.573101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59e160-8c10-4765-9f65-d38d42c524f3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:21.591922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 159/317] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:21.591922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a91d-4a98-4627-b118-5f2d5102282d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.591922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a91d-4a98-4627-b118-5f2d5102282d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.591922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a91d-4a98-4627-b118-5f2d5102282d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.592348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 159/318] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:16:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:21.592432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 160/319] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:21.598315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a91d-4a98-4627-b118-5f2d5102282d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:21.598967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78cac0-55f0-46db-b801-e5118217b17a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.599418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78cac0-55f0-46db-b801-e5118217b17a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.599852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78cac0-55f0-46db-b801-e5118217b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.633509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0b78cac0-55f0-46db-b801-e5118217b17a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:21.635000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0b78cac0-55f0-46db-b801-e5118217b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:21.743642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 160/320] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:21.754377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a91d-4a98-4627-b118-5f2d5102282d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:21.793369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:21.825096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:21.825716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:21.826000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:21.826278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:21.896028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:21.897509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:21.916236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78cac0-55f0-46db-b801-e5118217b17a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:21.937183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.017633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 161/321] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 12:16:22.024417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.043851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.050564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78cac0-55f0-46db-b801-e5118217b17a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.091530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.092209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.092500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.092774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.105005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:22.110469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:22.111427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 161/322] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:16:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:22.113351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.147854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f546f-728c-4732-b165-5b629c9be179 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.187413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.188083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.188361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.188636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.189745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:22.191246 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:22.192943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 162/323] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:22.193731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.209781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.245288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a1a41-4d9e-4a64-aad9-f157c05e48f6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.285110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.285668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.285951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.286222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.295897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.301865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:22.307552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:22.308650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 162/324] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:22.309722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.320135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec8c63-1e37-460a-ac32-8428cb434a01 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.359580 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.360127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.360411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.360684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.361346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:22.361654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:22.363349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:22.373083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 163/325] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:22.373710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.431131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb521dc-9a80-461e-8cca-052b410e8a23 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.474358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.474987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.475261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.475531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.477259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:22.478680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:22.480326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 163/326] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:22.481086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.485368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.491051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafab59c-2b5c-4f1f-b74a-adcbe324679b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.529437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.530285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.530559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.530832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.531850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:22.531850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:22.533200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:22.542302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 164/327] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:22.543056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.552710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.597377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a3ad0-78fa-499d-8dd1-dc00cca5d717 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.629733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.630332 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.630612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.630889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.640755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633df3-18b3-4d7f-bf81-07216576328f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.673443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.674032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.674314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.674591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.675320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] RBAC: Adding query filter params (group.id=1e8b475bd8204235b2d31657da4a2512, role.id=5b5518e8da0949ae9f1215f2739e508b, scope.project.id=2b73fc2052414f9e9b362f20d9968b50) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:22.675631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:22.677089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:22.682692 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 165/328] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/role_assignments?group.id=1e8b475bd8204235b2d31657da4a2512&scope.project.id=2b73fc2052414f9e9b362f20d9968b50&role.id=5b5518e8da0949ae9f1215f2739e508b => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:22.683472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.706393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:22.709111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:22.714467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.762609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.799719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d8b4a-7938-4293-99cc-deb3032426a4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.830174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 164/329] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:22.836715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:22.841675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.842295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.842571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.842840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.918541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:22.920033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:22.953902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7b2ee-f5d3-4b34-9038-be2d5c6565be None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:22.956213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:22.996663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:22.997297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:22.997574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:22.998453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] PATH_INFO: `/v3/projects/2b73fc2052414f9e9b362f20d9968b50` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:22.999438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] RBAC: Authorizing `identity:get_project(project_id=2b73fc2052414f9e9b362f20d9968b50)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:23.000913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:23.003823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 165/330] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/projects/2b73fc2052414f9e9b362f20d9968b50 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:23.004358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:23.009614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:23.044407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 166/331] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:23.050523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:23.124087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5b778-b4f9-4b86-baf0-ddeb1601c96d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:23.151481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841960e6-3eaf-46ac-a003-1f778772870e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:23.157368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:23.157987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:23.158265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:23.158572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] PATH_INFO: `/v3/groups/1e8b475bd8204235b2d31657da4a2512` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:23.159660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] RBAC: Authorizing `identity:get_group(group_id=1e8b475bd8204235b2d31657da4a2512)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:23.161127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:23.162677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 166/332] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 12 12:16:23 2022] GET /identity/v3/groups/1e8b475bd8204235b2d31657da4a2512 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:23.168914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:23.184921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:23.185542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:23.185824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:23.186099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] PATH_INFO: `/v3/projects/3f11c6a9324b4777879eb5cf98ff4596` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:23.187219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] RBAC: Authorizing `identity:get_project(project_id=3f11c6a9324b4777879eb5cf98ff4596)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:23.188685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:23.190299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 167/333] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:16:23 2022] GET /identity/v3/projects/3f11c6a9324b4777879eb5cf98ff4596 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:23.195554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:23.211732 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:23.233973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:23.268427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e6860-1e40-4932-87a1-13c5769b0e70 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:23.293674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdda7f5-2740-40e6-9b65-77f174d42201 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:23.301992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:23.302534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:23.302818 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:23.303088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:23.303833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] RBAC: Adding query filter params (group.id=1e8b475bd8204235b2d31657da4a2512, role.id=1aeee7a88610411d8ff149cc0528f706, scope.project.id=2b73fc2052414f9e9b362f20d9968b50) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:23.304147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:23.305602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:23.311710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 167/334] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 12 12:16:23 2022] GET /identity/v3/role_assignments?group.id=1e8b475bd8204235b2d31657da4a2512&scope.project.id=2b73fc2052414f9e9b362f20d9968b50&role.id=1aeee7a88610411d8ff149cc0528f706 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:23.328936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6416d-a1f7-468c-80e8-a8d4bf72b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:23.329588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6416d-a1f7-468c-80e8-a8d4bf72b57d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:23.329867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6416d-a1f7-468c-80e8-a8d4bf72b57d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:23.330137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6416d-a1f7-468c-80e8-a8d4bf72b57d None admin] PATH_INFO: `/v3/groups/e3f7f48774834bdfa646ebe2bd1754d6` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:23.331305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6416d-a1f7-468c-80e8-a8d4bf72b57d None admin] RBAC: Authorizing `identity:get_group(group_id=e3f7f48774834bdfa646ebe2bd1754d6)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:23.332817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6416d-a1f7-468c-80e8-a8d4bf72b57d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:23.334463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 168/335] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Oct 12 12:16:23 2022] GET /identity/v3/groups/e3f7f48774834bdfa646ebe2bd1754d6 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:23.341213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:23.443693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed58a29-c59f-4b12-b7b7-37cdb343ca54 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:23.446356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:23.480772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a657aa-ef1f-42d3-b79c-e7415fa525a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:23.481378 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a657aa-ef1f-42d3-b79c-e7415fa525a1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:23.481655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a657aa-ef1f-42d3-b79c-e7415fa525a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:23.481924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a657aa-ef1f-42d3-b79c-e7415fa525a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:23.482650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a657aa-ef1f-42d3-b79c-e7415fa525a1 None admin] RBAC: Adding query filter params (group.id=e3f7f48774834bdfa646ebe2bd1754d6, role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=3f11c6a9324b4777879eb5cf98ff4596) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:23.482954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a657aa-ef1f-42d3-b79c-e7415fa525a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:23.484424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a657aa-ef1f-42d3-b79c-e7415fa525a1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:23.490087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 168/336] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Oct 12 12:16:23 2022] GET /identity/v3/role_assignments?group.id=e3f7f48774834bdfa646ebe2bd1754d6&scope.project.id=3f11c6a9324b4777879eb5cf98ff4596&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:26.251589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6abf5-2f16-4784-88fe-40ba73395bfc None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:26.252563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6abf5-2f16-4784-88fe-40ba73395bfc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:26.252998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6abf5-2f16-4784-88fe-40ba73395bfc None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:26.254701 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 169/337] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:26.260185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c101e-a764-43c8-b31b-1d464ce8e8d9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:26.260929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c101e-a764-43c8-b31b-1d464ce8e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:26.261349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c101e-a764-43c8-b31b-1d464ce8e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:26.290510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-716c101e-a764-43c8-b31b-1d464ce8e8d9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:26.292033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-716c101e-a764-43c8-b31b-1d464ce8e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:26.390452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 169/338] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:26.415228 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cd36c-dce0-45ff-b403-81e444415c7f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:26.415534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cd36c-dce0-45ff-b403-81e444415c7f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:26.415785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cd36c-dce0-45ff-b403-81e444415c7f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:26.417418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 170/339] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:26.422727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc78b5-0b56-45fb-b862-811d6f28c528 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:26.423021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc78b5-0b56-45fb-b862-811d6f28c528 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:26.423302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc78b5-0b56-45fb-b862-811d6f28c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:26.439599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81c271-1fad-4e3c-8068-ed512b4882b4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:26.439906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81c271-1fad-4e3c-8068-ed512b4882b4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:26.440185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81c271-1fad-4e3c-8068-ed512b4882b4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:26.441657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 171/340] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:26.447123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406062-fb75-41ee-a084-1df8dd905436 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:26.447640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406062-fb75-41ee-a084-1df8dd905436 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:26.448132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406062-fb75-41ee-a084-1df8dd905436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:26.451857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cfcc78b5-0b56-45fb-b862-811d6f28c528 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:26.454361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cfcc78b5-0b56-45fb-b862-811d6f28c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:26.481800 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7b406062-fb75-41ee-a084-1df8dd905436 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:26.484478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7b406062-fb75-41ee-a084-1df8dd905436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:26.563093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 170/341] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:26.596122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 172/342] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:26.694330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc78b5-0b56-45fb-b862-811d6f28c528 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:26.727617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:26.837008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc78b5-0b56-45fb-b862-811d6f28c528 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:26.869686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406062-fb75-41ee-a084-1df8dd905436 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:26.875841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:26.875841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:26.875841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:26.875841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:26.894733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:26.896227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:26.922337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:26.923372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:26.924431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:26.924431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:26.924431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:26.924431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 171/343] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:26.925330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:26.940169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:27.022366 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406062-fb75-41ee-a084-1df8dd905436 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.025199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:27.046989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcbfc6-f62a-4e12-a7ac-693b37cf0ca6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.068153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.069137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.070027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.071071 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.084501 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f57b1f-f05d-4453-a8a2-a9a452c262f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.085363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f57b1f-f05d-4453-a8a2-a9a452c262f4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.086024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.086233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f57b1f-f05d-4453-a8a2-a9a452c262f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.086692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f57b1f-f05d-4453-a8a2-a9a452c262f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.088187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.101730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f57b1f-f05d-4453-a8a2-a9a452c262f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.103396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f57b1f-f05d-4453-a8a2-a9a452c262f4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:27.109357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:27.110282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:27.111166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:27.111166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:27.111166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:27.111166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 173/344] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:27.116595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-15f57b1f-f05d-4453-a8a2-a9a452c262f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:27.126029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:27.126917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:27.127825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:27.127825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:27.127825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:27.134336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 172/345] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:27.134336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93bad-7751-4e8b-b872-0827bfedfab8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.134336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93bad-7751-4e8b-b872-0827bfedfab8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.134336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93bad-7751-4e8b-b872-0827bfedfab8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.134336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 173/346] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:27.134336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93bad-7751-4e8b-b872-0827bfedfab8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:27.213413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:27.226952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c3da4-7ec6-4277-880f-72cdfb8034e7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.240426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93bad-7751-4e8b-b872-0827bfedfab8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.263716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.264449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.264640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.264906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.265556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:27.265862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.267247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.272062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:27.277888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a59a3-6a87-41bd-a627-66dc4d94997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.278600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a59a3-6a87-41bd-a627-66dc4d94997e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.278871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a59a3-6a87-41bd-a627-66dc4d94997e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.279141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a59a3-6a87-41bd-a627-66dc4d94997e None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.279778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a59a3-6a87-41bd-a627-66dc4d94997e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:27.280103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a59a3-6a87-41bd-a627-66dc4d94997e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.281531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a59a3-6a87-41bd-a627-66dc4d94997e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.290159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 174/347] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:27.290159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:27.294067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 174/348] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:27.295251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e92f7-767a-4212-bf6c-e4743032d80b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.295536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e92f7-767a-4212-bf6c-e4743032d80b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.295837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e92f7-767a-4212-bf6c-e4743032d80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.314762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-278e92f7-767a-4212-bf6c-e4743032d80b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:27.316201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-278e92f7-767a-4212-bf6c-e4743032d80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:27.391910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 175/349] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:27.391910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e92f7-767a-4212-bf6c-e4743032d80b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:27.397090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72641493-9047-47b6-8867-fa1103b5810e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.443333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.444028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.444310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.444582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.445441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:27.445748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.447283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.465338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 175/350] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:27.465338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:27.473974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:27.513808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e92f7-767a-4212-bf6c-e4743032d80b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.539955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:27.552790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.553400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.553680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.553953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.555172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.556641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.567866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7643-58c6-4b8f-b2e4-05b6db330ad3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.581362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 176/351] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:27 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:27.582142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:27.619120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6df4b-74f1-4895-ab41-6c0df7251143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.620219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6df4b-74f1-4895-ab41-6c0df7251143 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.620507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6df4b-74f1-4895-ab41-6c0df7251143 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.620835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6df4b-74f1-4895-ab41-6c0df7251143 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.621500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6df4b-74f1-4895-ab41-6c0df7251143 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.623088 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6df4b-74f1-4895-ab41-6c0df7251143 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.650054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 176/352] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:27 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:27.651507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7b1fe-fbd4-4390-9cf5-65cc9d44e177 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.651826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7b1fe-fbd4-4390-9cf5-65cc9d44e177 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.652101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7b1fe-fbd4-4390-9cf5-65cc9d44e177 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.657797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 177/353] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:27.660119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666dea-93b6-42cd-80cd-31f91286e395 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.660711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666dea-93b6-42cd-80cd-31f91286e395 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.661197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666dea-93b6-42cd-80cd-31f91286e395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.682027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-19666dea-93b6-42cd-80cd-31f91286e395 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:27.683741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-19666dea-93b6-42cd-80cd-31f91286e395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:27.713861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348335c-ac7a-42b5-bb2f-4a89f5734156 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.758995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:27.760551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.761306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.761582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.761861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.762538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.764074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.773186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 178/354] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:27.774334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19666dea-93b6-42cd-80cd-31f91286e395 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:27.802871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 177/355] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:27 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:27.921145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19666dea-93b6-42cd-80cd-31f91286e395 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:27.961788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:27.962443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:27.962719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:27.962985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:27.974346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:27.975872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:27.993676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:27.994644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:27.995532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:27.995532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:27.995532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:27.995532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 179/356] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:28.002031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:28.043995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:28.090768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:28.118341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b906-f062-4341-b5db-9d19f849a37e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:28.152808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:28.165560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:28.165789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:28.166143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:28.166488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:28.167222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:28.167621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:28.169426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:28.184505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 178/357] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:28.191118 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:28.222015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61306412-b2e6-4b25-82df-428d3c89d10d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:28.285897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:28.286538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:28.286764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:28.287037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:28.287729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:28.289684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:28.305345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:28.307785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 12:16:28.307785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 12:16:28.307785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [parameters: {'id': '81f9d46b96d54381b0360112c6d4e7b3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 12:16:28.307785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:16:28.325260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d2f6b-b105-47ed-891d-38c4ae741ca6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:16:28.332188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return ref.to_dict() Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:16:28.333893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:16:28.335758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:16:28.336995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:16:28.337870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:16:28.338672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'id': '81f9d46b96d54381b0360112c6d4e7b3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:28.339473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 12:16:28.342051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:28.348410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 180/358] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 12 12:16:28 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:28.348410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:28.406946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:28.408904 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:28.409193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:28.409467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:28.410126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:28.413758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:28.457245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 179/359] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:28 2022] POST /identity/v3/users => generated 249 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:16:28.509526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03466c-3ba3-492c-ab85-2732c6328edf None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:28.520609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:28.555320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec5a33-19e4-4c6f-bde2-0f89f8225470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:28.556078 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5a33-19e4-4c6f-bde2-0f89f8225470 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:28.556370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5a33-19e4-4c6f-bde2-0f89f8225470 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:28.556645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5a33-19e4-4c6f-bde2-0f89f8225470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:28.569810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec5a33-19e4-4c6f-bde2-0f89f8225470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5dec5a33-19e4-4c6f-bde2-0f89f8225470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:28.574956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:28.575909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:28.576772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 181/360] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:16:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:28.585327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:28.719001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f1ff-81cd-4ede-9afd-8fac5076cafa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:28.763378 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bbdc9-cf19-45eb-bce9-ed21e14aec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:28.764048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbdc9-cf19-45eb-bce9-ed21e14aec3e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:28.764334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbdc9-cf19-45eb-bce9-ed21e14aec3e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:28.764608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bbdc9-cf19-45eb-bce9-ed21e14aec3e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:28.765287 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bbdc9-cf19-45eb-bce9-ed21e14aec3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:28.765592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bbdc9-cf19-45eb-bce9-ed21e14aec3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:28.766963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bbdc9-cf19-45eb-bce9-ed21e14aec3e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:28.781741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 180/361] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:30.306858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1f44-c07e-4a3c-8341-05035b7b723c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:30.307401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1f44-c07e-4a3c-8341-05035b7b723c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:30.307401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1f44-c07e-4a3c-8341-05035b7b723c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:30.309037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 182/362] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:30.311925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd22e-b5d2-4db8-ac13-4684064a88bd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:30.312324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd22e-b5d2-4db8-ac13-4684064a88bd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:30.312483 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd22e-b5d2-4db8-ac13-4684064a88bd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:30.314023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 181/363] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:30.318110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0ced-1c7a-4e49-89f8-c4eef5223b2c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:30.318397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0ced-1c7a-4e49-89f8-c4eef5223b2c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:30.318677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0ced-1c7a-4e49-89f8-c4eef5223b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:30.319969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cec5a-0c79-4844-8ce3-17fd862e5c3d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:30.320718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cec5a-0c79-4844-8ce3-17fd862e5c3d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:30.320991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cec5a-0c79-4844-8ce3-17fd862e5c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:30.346583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-657b0ced-1c7a-4e49-89f8-c4eef5223b2c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:30.347754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-657b0ced-1c7a-4e49-89f8-c4eef5223b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:30.368971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1d4cec5a-0c79-4844-8ce3-17fd862e5c3d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:30.370301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1d4cec5a-0c79-4844-8ce3-17fd862e5c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:30.378628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:30.464546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 183/364] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:30.478145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 182/365] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:30.596016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd0848-d652-461c-bd41-4ef09909965a None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:30.596357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd0848-d652-461c-bd41-4ef09909965a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:30.596582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd0848-d652-461c-bd41-4ef09909965a None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:30.598208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 184/366] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:30.603607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13333d96-fe8c-45b7-8d31-5cbc26b81325 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:30.603942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13333d96-fe8c-45b7-8d31-5cbc26b81325 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:30.604307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13333d96-fe8c-45b7-8d31-5cbc26b81325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:30.633327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-13333d96-fe8c-45b7-8d31-5cbc26b81325 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:30.634552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-13333d96-fe8c-45b7-8d31-5cbc26b81325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:30.716267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 183/367] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:30.821250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd0848-d652-461c-bd41-4ef09909965a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:30.824843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13333d96-fe8c-45b7-8d31-5cbc26b81325 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:30.912257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:30.960742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13333d96-fe8c-45b7-8d31-5cbc26b81325 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:30.993733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:30.999919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd0848-d652-461c-bd41-4ef09909965a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.016721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.017360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.017642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.017920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.037618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:31.042549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:31.043440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:31.044273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:31.048192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 184/368] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:31.053391 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.067963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.068660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.068942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.069213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.086961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:31.096857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:31.097779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:31.098604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:31.099697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 185/369] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:31.105163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.213877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1bcc0-0b4d-41f3-873e-d2bdb497e06b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.245210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07066b9-5697-4793-834b-a3ebf1a0ca16 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.254765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:31.262413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.263707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.264178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.264463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.265178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:31.265489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.266870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.279831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 185/370] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:31.279831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.292674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38e9b5-9e80-4260-8f64-aeefa93e0bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.293185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e9b5-9e80-4260-8f64-aeefa93e0bfb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.293458 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e9b5-9e80-4260-8f64-aeefa93e0bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.293729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e9b5-9e80-4260-8f64-aeefa93e0bfb None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.294386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e9b5-9e80-4260-8f64-aeefa93e0bfb None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:31.294682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e9b5-9e80-4260-8f64-aeefa93e0bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.296350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e9b5-9e80-4260-8f64-aeefa93e0bfb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.306352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 186/371] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:31.307947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6af24-4b3d-4389-bc03-f4668dc7f480 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.308477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6af24-4b3d-4389-bc03-f4668dc7f480 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.308477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6af24-4b3d-4389-bc03-f4668dc7f480 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.310515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 187/372] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:31.311397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6af24-4b3d-4389-bc03-f4668dc7f480 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.340066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:31.387048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683dc5-0432-40f8-a77a-dd5b274060b0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.423725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6af24-4b3d-4389-bc03-f4668dc7f480 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.424313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.424940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.425466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.425737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.440138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:31.447052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:31.448279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 186/373] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:31.455042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.462565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ff066-c56c-4d48-88ed-e6c9994da613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.463221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff066-c56c-4d48-88ed-e6c9994da613 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.463500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff066-c56c-4d48-88ed-e6c9994da613 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.463772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff066-c56c-4d48-88ed-e6c9994da613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.476500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ff066-c56c-4d48-88ed-e6c9994da613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.477909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ff066-c56c-4d48-88ed-e6c9994da613 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-259ff066-c56c-4d48-88ed-e6c9994da613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:31.493919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:31.494877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:31.495734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:31.495734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:31.495734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:31.495734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 188/374] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:31.496297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39337-696b-4e4d-acf5-6d057855f4ac None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.496546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39337-696b-4e4d-acf5-6d057855f4ac None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.496826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39337-696b-4e4d-acf5-6d057855f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.514789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-34b39337-696b-4e4d-acf5-6d057855f4ac None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:31.516007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-34b39337-696b-4e4d-acf5-6d057855f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:31.524133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:31.578032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c2dfb-a24a-4a8b-a7f6-b0f2391d3556 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.586067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 189/375] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:31.586835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39337-696b-4e4d-acf5-6d057855f4ac None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.589878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:31.614026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.614661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.614970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.615240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.626205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.627648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:31.641833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:31.642760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:31.644099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:31.644099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:31.644099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:31.644099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 187/376] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:31.644099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.695674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39337-696b-4e4d-acf5-6d057855f4ac None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.729664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8638-cfef-4746-ab21-0c7f3991920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.730198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8638-cfef-4746-ab21-0c7f3991920e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.730480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8638-cfef-4746-ab21-0c7f3991920e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.730758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8638-cfef-4746-ab21-0c7f3991920e None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.731418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8638-cfef-4746-ab21-0c7f3991920e None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:31.731717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8638-cfef-4746-ab21-0c7f3991920e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.733127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8638-cfef-4746-ab21-0c7f3991920e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.740769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 190/377] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:31.742009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591382-d384-4c46-86e0-d36836f2f778 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.742305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591382-d384-4c46-86e0-d36836f2f778 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.742581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591382-d384-4c46-86e0-d36836f2f778 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.743980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 191/378] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:31.744585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05591382-d384-4c46-86e0-d36836f2f778 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.763214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fa233-4f52-4fd4-a478-fe7739cbcbb6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.771599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:31.805794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.806392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.806670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.806938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.807569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:31.807897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.809256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.816484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:31.825624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 188/379] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:31.825624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.858883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05591382-d384-4c46-86e0-d36836f2f778 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.892552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086db81-6d45-432a-95d1-503b69781d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.893157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086db81-6d45-432a-95d1-503b69781d61 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.893434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086db81-6d45-432a-95d1-503b69781d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.893702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086db81-6d45-432a-95d1-503b69781d61 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.894333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086db81-6d45-432a-95d1-503b69781d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:31.894637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086db81-6d45-432a-95d1-503b69781d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.896031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086db81-6d45-432a-95d1-503b69781d61 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.907463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 192/380] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:31.908616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499fbbd-b822-42a6-8ccd-4aba34fb051b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.908899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499fbbd-b822-42a6-8ccd-4aba34fb051b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.909172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499fbbd-b822-42a6-8ccd-4aba34fb051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.926020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0499fbbd-b822-42a6-8ccd-4aba34fb051b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:31.927216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0499fbbd-b822-42a6-8ccd-4aba34fb051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:31.927346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa590662-c55d-4cf0-b096-0e98adaf7509 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:31.962659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:31.963275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:31.963556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:31.963854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:31.973672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:31.975146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:31.989400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:31.990286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:31.991143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:31.991143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:31.991143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:31.991143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 189/381] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:31.991143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:31.991775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 193/382] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:31.992637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499fbbd-b822-42a6-8ccd-4aba34fb051b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.015318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.063430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.104840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0707-d84d-4253-80f9-bca888ca7d4b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.110923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499fbbd-b822-42a6-8ccd-4aba34fb051b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.139071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.139912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.140374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.140692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.147630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.148605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.148904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.149185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.149459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.150035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.159577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:32.162747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:32.163668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:32.164631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 190/383] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:32.165204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:32.166021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:32.166803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 194/384] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:32.168630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.171843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.261649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.272305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55956d-4c85-410a-b734-c514639840b5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.284794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ca17-6209-4b43-a8dd-8022817539ad None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.288491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.306271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.306877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.307154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.307426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.308114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:32.308643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.309761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.318295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.318914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.319192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.319459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.321039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 195/385] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:32.321816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.331519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.333092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:32.344090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:32.345102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 191/386] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:32.346000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.420247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6f5f-26e9-4f92-926f-9defa6dd7a14 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.446176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bac09-a125-47be-84ee-e807e993c893 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.453194 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.454056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.454331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.454597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.455317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:32.455821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.457534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.479182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.479784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.480090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.480363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.481024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:32.481325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.482686 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.487688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.492273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 192/387] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:32.493098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.498658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 196/388] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:32.498658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.528872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.594963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b158d17-d70e-4ba7-9c11-d1341b90216e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.595558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eac3e-cfd8-40b4-b080-4759878c1a9e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.628755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.629307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.629422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.629645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.629917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.630025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.630195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.630467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.636737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.638199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.640489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.641994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:32.650824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:32.651934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 197/389] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:32.657660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:32.659917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:32.660782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:32.661630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:32.661630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:32.661630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:32.661630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 193/390] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:32.661630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.711856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.745227 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.752517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8cf50-69f7-463e-a097-c1075b2e35b8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.759594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bb8d6-fd65-4aec-96bf-bcf90bb42e4e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.787400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.787983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.788260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.788562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.789286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:32.789586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.791691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.796496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.797112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.797394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.797665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.808177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.808379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 198/391] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:32.809128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.809616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:32.826181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:32.827089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:32.828164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:32.828164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:32.828164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:32.828164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 194/392] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:32.828164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.909251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7020622-873f-48c2-bba5-2cfd591fd633 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.927442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c2db-0590-4c9b-af63-b56456660a31 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:32.930149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:32.941600 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.942223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.942504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.942778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.952987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.954698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.963450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:32.964078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:32.964361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:32.964632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:32.965365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:32.965671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:32.967081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:32.969584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:32.970709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:32.971563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:32.971563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:32.971563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:32.971563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 199/393] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:32.971563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:32.978708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.004553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 195/394] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:33.005632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.077308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111024b-f788-4b3b-8579-0f34add1e3e9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.102169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be8f07-b28d-4d77-aa61-54c919666968 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.109630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.110237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.110518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.110792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.111437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:33.111739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.113152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.125212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 200/395] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:33.125989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.135322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.135985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.136271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.136542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.146454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.147961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:33.162217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:33.163163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:33.164200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:33.164200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:33.164200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:33.164200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 196/396] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:33.164200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.181610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.193742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.229934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ffc4-fe27-4a6f-8a60-9db0f0d88bec None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.264183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31799982-8027-4afb-9fc5-74e17bc14cd0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.264390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.264989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.265269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.265541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.266179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:33.266484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.267890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.278683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 201/397] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:33.279465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.300572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.301166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.301441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.301706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.302336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:33.302629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.304566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.315860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 197/398] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:33.317995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.376244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c48ca-9f82-4c5b-a5f1-1c8dfc7cb666 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.391554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.399252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.410561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.411181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.411514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.411814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.415608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743af76-b7fd-4829-9091-0291ad49d1c8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.422336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.423790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:33.438718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:33.439651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:33.440777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:33.440777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:33.440777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:33.440777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 202/399] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:33.440777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.453300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.454467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.454906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.455182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.455878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.457373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.478628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 198/400] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:33 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:33.479517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.548088 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92713e73-3da7-4ceb-bcec-80094339a9f8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.587605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.588258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.588539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.588920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.589462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:33.589765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.591160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.604346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 203/401] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:33.609477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.617835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59928a8-6f01-45bf-813e-1dcaf08d9f51 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.647758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.651710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.661103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.662147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.662433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.662858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.670848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.672344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:33.684047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:33.684948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:33.685858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 199/402] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:33.686424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.723012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cbc2b-6798-4f2b-8c34-7013ce0c906c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.757464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.758103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.758386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.758664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.766383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.767873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:33.782046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:33.782925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:33.783776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:33.784837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 204/403] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:33.784837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.804626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09380-e72f-4425-b0ef-568730acbead None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.841890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.842615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.842899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.843175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.843832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:33.844147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.845652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.863663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 200/404] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:33.863663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.888456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.895897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3620d-512c-41f5-a60c-08e3d765ba38 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:33.914346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:33.931541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:33.932197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:33.932474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:33.932746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:33.939248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:33.940719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:33.951667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:33.952747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:33.953863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 205/405] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:33.954373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:33.971533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957de8-8e9f-4047-a2e9-42d44a303344 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.008112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.008800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.009085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.009358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.010084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:34.010390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.011832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.035685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 201/406] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:34.035685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.059421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4843f22-f794-4543-a1f4-a30e6fab7d02 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.094049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.094657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.094936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.095211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.095935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:34.096272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.097679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.120483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 206/407] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:34.120483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.139193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:34.144921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24945df-d867-4ecf-a5bd-67c9bab08aab None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.155983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:34.181837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.182381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.182658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.182928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.189772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.191213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:34.204369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:34.205270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:34.206114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 202/408] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:34.206586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.230434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2fabc-3268-4413-9b3d-8c207443c49a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.265857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.266462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.266748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.267029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.267721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:34.268061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.269546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.281660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 207/409] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:34.282454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.311724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e507-ac12-4e7c-a414-2de4d55ec3a5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.348241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.349016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.349301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.349578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.361884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.363364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.375488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:34.380111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:34.381059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:34.381927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:34.381927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:34.381927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:34.381927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 203/410] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:34.386942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.407413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3098e6-2b92-4794-a824-f68ae9023c8e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.421437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:34.443086 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.443670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.443978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.444254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/09fb6adedea24758bd852be1702cd1d4/roles/4419e40f34ef48d3875a6b7cf51a528b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.461413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=09fb6adedea24758bd852be1702cd1d4, role_id=4419e40f34ef48d3875a6b7cf51a528b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.462855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.476407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 208/411] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:34 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/09fb6adedea24758bd852be1702cd1d4/roles/4419e40f34ef48d3875a6b7cf51a528b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:34.477278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.524508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ba77e-bd6a-4d63-bc48-d47042d1611d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.566011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.566985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.567436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.568006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.569079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:34.569636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.571522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.595967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 204/412] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:34.597101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.625265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd33f-977d-434d-8e2b-6766c486995e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.666539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:34.681278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.681944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.682258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.682534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/c01495a37066445293bdb957ece67e20/roles/4419e40f34ef48d3875a6b7cf51a528b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.700865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:34.705755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=c01495a37066445293bdb957ece67e20, role_id=4419e40f34ef48d3875a6b7cf51a528b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.709078 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.725455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3821-9906-4575-be9c-15c1dcc4e2bb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.726378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 209/413] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:34 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/c01495a37066445293bdb957ece67e20/roles/4419e40f34ef48d3875a6b7cf51a528b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:34.727198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.772261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.775617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.775617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.775617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.776057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:34.779851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.779851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:34.805272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 205/414] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:34.811407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:34.912473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e7a34-bc86-458d-87ed-ae387820e8fb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.965236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:34.966322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:34.966745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:34.967161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/ce79e1215c0345a59146c8bf6fe26cb7/roles/4419e40f34ef48d3875a6b7cf51a528b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:34.989632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2ac63-ffff-4b7f-96ed-7b054d57a4cd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:34.990689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=ce79e1215c0345a59146c8bf6fe26cb7, role_id=4419e40f34ef48d3875a6b7cf51a528b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:34.992478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:35.015963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 210/415] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:34 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/ce79e1215c0345a59146c8bf6fe26cb7/roles/4419e40f34ef48d3875a6b7cf51a528b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:35.033692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:35.034482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:35.034801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:35.035073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:35.043475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:35.045141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:35.048251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:35.060143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:35.061995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:35.063205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 206/416] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:35.067281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:35.118598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:35.226300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808c7f2-501a-4850-a3a4-5b61955728b8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:35.283604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d5ab0-3a7d-4a17-ad19-45d0958cf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:35.284245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d5ab0-3a7d-4a17-ad19-45d0958cf511 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:35.284521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d5ab0-3a7d-4a17-ad19-45d0958cf511 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:35.284846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d5ab0-3a7d-4a17-ad19-45d0958cf511 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:35.285584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d5ab0-3a7d-4a17-ad19-45d0958cf511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:35.285885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d5ab0-3a7d-4a17-ad19-45d0958cf511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:35.287303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d5ab0-3a7d-4a17-ad19-45d0958cf511 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:35.300150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 211/417] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:35.306372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:35.414481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac37cc3-93c0-4742-9796-9804bc2b58d0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:35.451019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cbed2-91b8-4de7-a490-91304e3e2665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:35.451697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cbed2-91b8-4de7-a490-91304e3e2665 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:35.452007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cbed2-91b8-4de7-a490-91304e3e2665 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:35.452282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cbed2-91b8-4de7-a490-91304e3e2665 None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/319b5538054c49d19ecc0b9c9cfc5b5b/roles/4419e40f34ef48d3875a6b7cf51a528b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:35.470917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cbed2-91b8-4de7-a490-91304e3e2665 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=319b5538054c49d19ecc0b9c9cfc5b5b, role_id=4419e40f34ef48d3875a6b7cf51a528b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:35.472723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cbed2-91b8-4de7-a490-91304e3e2665 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:35.492075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 207/418] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:35 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/319b5538054c49d19ecc0b9c9cfc5b5b/roles/4419e40f34ef48d3875a6b7cf51a528b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:35.807234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef5187-a19a-4ed7-b55b-8b5c4a0319bb None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:35.807925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef5187-a19a-4ed7-b55b-8b5c4a0319bb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:35.807925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef5187-a19a-4ed7-b55b-8b5c4a0319bb None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:35.809430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 212/419] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:35.820902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e17f2-69a9-4ac2-9279-36bf61712809 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:35.821510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e17f2-69a9-4ac2-9279-36bf61712809 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:35.821510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e17f2-69a9-4ac2-9279-36bf61712809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:35.843227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0b2e17f2-69a9-4ac2-9279-36bf61712809 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:35.844452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0b2e17f2-69a9-4ac2-9279-36bf61712809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:35.898278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:35.923775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 208/420] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:36.341094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef5187-a19a-4ed7-b55b-8b5c4a0319bb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:36.454660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:36.474425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef5187-a19a-4ed7-b55b-8b5c4a0319bb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:36.518177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:36.519129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:36.519626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:36.520108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:36.536270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:36.541306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:36.542179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:36.542990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:36.545525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 213/421] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:36.551226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e17f2-69a9-4ac2-9279-36bf61712809 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:36.713612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e17f2-69a9-4ac2-9279-36bf61712809 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:36.763267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f940f-51da-4bb3-8524-d223eb381327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:36.763917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f940f-51da-4bb3-8524-d223eb381327 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:36.764201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f940f-51da-4bb3-8524-d223eb381327 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:36.764475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f940f-51da-4bb3-8524-d223eb381327 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:36.765154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f940f-51da-4bb3-8524-d223eb381327 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:36.765459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f940f-51da-4bb3-8524-d223eb381327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:36.766840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f940f-51da-4bb3-8524-d223eb381327 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:36.783212 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 209/422] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:36.788916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:36.948417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51ee03-272a-4b1d-b203-92191513f50c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:36.993114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571cb25-8071-4297-9fa9-ec3ef7151819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:36.994062 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571cb25-8071-4297-9fa9-ec3ef7151819 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:36.994534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571cb25-8071-4297-9fa9-ec3ef7151819 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:36.995014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571cb25-8071-4297-9fa9-ec3ef7151819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.005608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571cb25-8071-4297-9fa9-ec3ef7151819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:37.007956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571cb25-8071-4297-9fa9-ec3ef7151819 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:37.013590 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cc9c-ba4a-4531-98f8-93c34ceddfe2 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.014029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cc9c-ba4a-4531-98f8-93c34ceddfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.014127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960cc9c-ba4a-4531-98f8-93c34ceddfe2 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.015786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 210/423] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:37.018903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-2571cb25-8071-4297-9fa9-ec3ef7151819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:37.028273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:37.029157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:37.030022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:37.030022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:37.030022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:37.030022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 214/424] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:37.036824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cc9c-ba4a-4531-98f8-93c34ceddfe2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:37.042089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07952bb-4ea2-48d3-b5a5-ba4bde9b912b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.042377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07952bb-4ea2-48d3-b5a5-ba4bde9b912b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.042657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07952bb-4ea2-48d3-b5a5-ba4bde9b912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.062317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d07952bb-4ea2-48d3-b5a5-ba4bde9b912b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:37.063858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d07952bb-4ea2-48d3-b5a5-ba4bde9b912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:37.146812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:37.150735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 215/425] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:37.209054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960cc9c-ba4a-4531-98f8-93c34ceddfe2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:37.247367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93809762-7105-4fd5-ae98-9fcd00071cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:37.247989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93809762-7105-4fd5-ae98-9fcd00071cea None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.248275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93809762-7105-4fd5-ae98-9fcd00071cea None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.248552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93809762-7105-4fd5-ae98-9fcd00071cea None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.249223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93809762-7105-4fd5-ae98-9fcd00071cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:37.249598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93809762-7105-4fd5-ae98-9fcd00071cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:37.251266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93809762-7105-4fd5-ae98-9fcd00071cea None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:37.265673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 211/426] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:37.271338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07952bb-4ea2-48d3-b5a5-ba4bde9b912b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:37.355658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9d45-0466-486d-9e15-83d9eaf0d83d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.356047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9d45-0466-486d-9e15-83d9eaf0d83d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.356323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9d45-0466-486d-9e15-83d9eaf0d83d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.357932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 212/427] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:37.365141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1111f2-fc27-4f11-a2bd-dcf3bd1e5d82 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.365667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1111f2-fc27-4f11-a2bd-dcf3bd1e5d82 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.366210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1111f2-fc27-4f11-a2bd-dcf3bd1e5d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.385049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9c1111f2-fc27-4f11-a2bd-dcf3bd1e5d82 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:37.386727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9c1111f2-fc27-4f11-a2bd-dcf3bd1e5d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:37.423777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07952bb-4ea2-48d3-b5a5-ba4bde9b912b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:37.479925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:37.495015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:37.495648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.495972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.496242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] PATH_INFO: `/v3/users/swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.506471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:37.508036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:37.511249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 213/428] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:37.512623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1111f2-fc27-4f11-a2bd-dcf3bd1e5d82 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:37.524043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:37.524966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:37.529915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 216/429] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:37.532760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:37.553222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:37.638959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1111f2-fc27-4f11-a2bd-dcf3bd1e5d82 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:37.651492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa485-df34-44f5-9c9f-3b0b482642df None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:37.691676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:37.691676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.691676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.691676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.692103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:37.692103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:37.692103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:37.693300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:37.693943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.694256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.694530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.719836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:37.729116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 217/430] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:37.730140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:37.731018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:37.731819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 214/431] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:37.732990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:37.741979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:37.841077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:37.872547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:37.892179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e54e4-a744-4c0c-990b-469e1ab0d185 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:37.929328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fe09-4173-4c08-8783-bb2a1231fa25 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:37.935045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466d411-68d3-42b0-952d-bba6cc823b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:37.935893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d411-68d3-42b0-952d-bba6cc823b2d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.936312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d411-68d3-42b0-952d-bba6cc823b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.936722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d411-68d3-42b0-952d-bba6cc823b2d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.937966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466d411-68d3-42b0-952d-bba6cc823b2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:37.938413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466d411-68d3-42b0-952d-bba6cc823b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:37.940304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466d411-68d3-42b0-952d-bba6cc823b2d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:37.950203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 215/432] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:37.955597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5f22-5621-4d96-a009-9d94d42b3986 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.955597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5f22-5621-4d96-a009-9d94d42b3986 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.955597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5f22-5621-4d96-a009-9d94d42b3986 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.955597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 216/433] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:37.955597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e5f22-5621-4d96-a009-9d94d42b3986 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:37.970263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:37.970894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:37.971174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:37.971443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:37.981555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:37.983024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:37.997843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:37.998751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:37.999591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:37.999591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:37.999591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:37.999591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 218/434] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:38.000263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.074830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e5f22-5621-4d96-a009-9d94d42b3986 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.107027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.111209 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7641-7280-465e-a9d9-f555e7146995 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.111376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d42049-5910-4498-b161-cea88d03b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.112062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42049-5910-4498-b161-cea88d03b98c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.112347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42049-5910-4498-b161-cea88d03b98c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.112622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42049-5910-4498-b161-cea88d03b98c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.124534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d42049-5910-4498-b161-cea88d03b98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f0d42049-5910-4498-b161-cea88d03b98c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:38.129385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:38.130288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:38.131100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:38.135780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 217/435] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:38.136944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384635-c8d4-402e-b4b9-a8c2aee5151d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.137235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384635-c8d4-402e-b4b9-a8c2aee5151d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.137501 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e384635-c8d4-402e-b4b9-a8c2aee5151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.146927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.148187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.148463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.148732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.156064 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1e384635-c8d4-402e-b4b9-a8c2aee5151d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:38.157252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1e384635-c8d4-402e-b4b9-a8c2aee5151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:38.159526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.160978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.167436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:38.175493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:38.176435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:38.177274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:38.177274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:38.177274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:38.177274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 219/436] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:38.177504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.235511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 218/437] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:38.236207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e384635-c8d4-402e-b4b9-a8c2aee5151d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.290587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a56d2-9d86-4ff4-a413-55d6240bf06e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.337169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.338320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.338816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.339288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.340383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:38.340924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.342740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.357470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 220/438] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:38.358939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.371199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e384635-c8d4-402e-b4b9-a8c2aee5151d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.374403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.414252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.415250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.415831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.416304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.417267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:38.417791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.419363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.430449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 219/439] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:38.431602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.440960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.482079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c95c5-c47a-4d41-b1f0-ba36bf32e6d7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.517313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.517923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.518205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.518479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.519119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:38.519416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.520818 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.532140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 221/440] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:38.532946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.546354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd25b4-4a7d-4678-afa8-afcf356a5dd3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.581598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89f92-affe-4b6b-9dbd-9acc5e5dd93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.582217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89f92-affe-4b6b-9dbd-9acc5e5dd93d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.582497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89f92-affe-4b6b-9dbd-9acc5e5dd93d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.582779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89f92-affe-4b6b-9dbd-9acc5e5dd93d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.589471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89f92-affe-4b6b-9dbd-9acc5e5dd93d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.590856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89f92-affe-4b6b-9dbd-9acc5e5dd93d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-10a89f92-affe-4b6b-9dbd-9acc5e5dd93d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:38.602526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:38.603412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:38.604291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:38.604700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.604771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 220/441] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:38.605328 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754a00-68ae-4b1d-a36a-ddeaceed988d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.605618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754a00-68ae-4b1d-a36a-ddeaceed988d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.605889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754a00-68ae-4b1d-a36a-ddeaceed988d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.611205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 221/442] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:38.611205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754a00-68ae-4b1d-a36a-ddeaceed988d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.636588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ac73f-cbf0-4bce-bbb6-24a101323de4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.669542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.670160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.670438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.670712 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.674006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.682230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.683671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:38.697369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:38.698277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:38.699146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:38.699146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:38.699146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:38.699146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 222/443] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:38.699380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.714869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754a00-68ae-4b1d-a36a-ddeaceed988d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.748366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.748989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.749272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.749547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.761235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:38.766458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:38.767336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 222/444] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:38.768487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.804875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0902c6-59ba-4511-ba14-a92ef21b2c96 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.826638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.838339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b5b9-454a-4abb-815b-05f6fc84762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.838961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b5b9-454a-4abb-815b-05f6fc84762d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.839242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b5b9-454a-4abb-815b-05f6fc84762d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.839563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b5b9-454a-4abb-815b-05f6fc84762d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.846778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b5b9-454a-4abb-815b-05f6fc84762d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.848255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b5b9-454a-4abb-815b-05f6fc84762d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c200b5b9-454a-4abb-815b-05f6fc84762d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:38.859725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:38.860652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:38.861550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 223/445] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:38.862107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc334c-b839-4c17-87f9-34ac8b7e93fd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.862284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc334c-b839-4c17-87f9-34ac8b7e93fd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.862535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc334c-b839-4c17-87f9-34ac8b7e93fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.872311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc3653-b422-49d7-b708-934b544fde53 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:38.880016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cebc334c-b839-4c17-87f9-34ac8b7e93fd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:38.881190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cebc334c-b839-4c17-87f9-34ac8b7e93fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:38.896998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:38.905969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:38.906573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:38.906854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:38.907129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:38.907839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:38.908151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:38.909582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:38.921714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 223/446] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:38.922498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:38.950296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 224/447] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:38.951127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc334c-b839-4c17-87f9-34ac8b7e93fd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.038789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafaff7-7346-4402-aa62-8fcaa3207ba9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.052026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc334c-b839-4c17-87f9-34ac8b7e93fd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.064826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.076495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.077373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.077655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.078051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.079055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:39.079362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.080736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.087307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.087940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.088222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.088503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.089164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:39.089472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.090880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.094008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 224/448] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:39.094972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.102438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 225/449] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:39.105185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.149013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.204803 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4f9a-28a0-41f1-983a-ccc08cd50ca7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.219482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9313c3-3e76-4ae5-9ace-69ea4516d3af None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.240298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.241149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.241429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.241862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.242595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:39.242902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.244357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.252607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.253256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.253538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.253811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/bc6e24255b28424ebb02c9319b40b25d/roles/4419e40f34ef48d3875a6b7cf51a528b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.262281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 225/450] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:39.263080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.270487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=bc6e24255b28424ebb02c9319b40b25d, role_id=4419e40f34ef48d3875a6b7cf51a528b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.272924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.286771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 226/451] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:39 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/bc6e24255b28424ebb02c9319b40b25d/roles/4419e40f34ef48d3875a6b7cf51a528b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:39.287557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.316232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.383759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bf3a9-a3a8-4347-8791-a6708e1674ce None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.386158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.405046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ba20b-d875-4247-b0aa-17e5dfb18f3e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.423653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.424336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.424623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.424898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.432809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.434285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.443623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.445090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.445520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.445936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:39.447318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:39.448397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 226/452] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:39.449327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.464898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.466377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:39.481353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:39.482449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:39.483336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:39.483336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:39.483336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:39.483336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 227/453] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:39.483556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.564278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103029a-8042-4a50-9f08-6087e606a051 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.567885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.592137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a4aa4-7689-4ae7-9952-b9fc22bde839 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.601887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.602636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.602916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.603193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.614103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:39.620753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:39.621739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:39.622577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 227/454] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:39.623868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.630558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.631176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.631461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.632374 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.650841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.698611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.700098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.733771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdccbd7-eac7-4964-89e8-0d59a8efe232 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.776063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.776249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.776504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.776776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.777508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:39.777813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.779175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.779294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.801944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 228/455] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:39.801944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.809043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 228/456] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:39.809904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.890880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:39.910607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8a7c-4457-464e-a82c-987974475455 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.913790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d2e95-fc56-4ac5-aaf8-3879d4cea04b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:39.948615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.949220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.949501 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.949771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.950407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:39.950705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.952092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.953500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:39.954286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:39.954763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:39.955102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:39.955850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:39.956220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:39.957634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:39.964043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 229/457] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:39.966346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 229/458] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:39.967322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:39.969385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.012591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.074791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7995fef-b970-4fc8-88ab-f496ba0c83ae None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.076979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b2beb-3783-448f-a8aa-8a2eef02232e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.111977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.112724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.113007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.113289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.114533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.115152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.115427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.115705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.126311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.127254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.128646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:40.144252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:40.145205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:40.146052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:40.146052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:40.146052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:40.146052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 230/459] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:40.146278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.196204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.197577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.245966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.257459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0cd23-ed14-4a80-b4d2-86f6490c6f54 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.293519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.294144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.294425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.294701 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.300545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 230/460] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:40.301187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.307633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.309116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:40.321612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:40.322539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 231/461] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:40.328798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.354291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.414650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6afc6-4be5-4dc8-aa2d-13d1410402c6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.425550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c492bc-c4f4-43e7-bd3c-0cdb5cce28de None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.453535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.454111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.454378 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.454646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.466239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.466439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.466844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.467123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.467393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.467711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.468063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:40.468412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.469763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.486369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 232/462] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:40.486369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:40.486618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:40.487420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:40.488395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:40.488395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:40.488395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:40.489777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 231/463] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:40.490604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.502107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.588570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.596296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511036d-98e0-4af9-9866-92811ffb2999 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.598270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7ec59-9d47-46c1-a58a-192d431398a3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.633494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.634145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.634434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.634706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.635437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:40.635745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.637202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.638013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.638632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.638904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.639170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.649343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.650763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.660384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 232/464] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:40.660384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:40.669280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:40.670215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:40.671597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:40.671597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:40.671597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:40.671597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 233/465] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:40.671597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.733383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.775422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cc8c2-2e99-44c6-a6dc-3a34def190ef None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.778814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ce5d0-6a38-4868-8a95-2e99f1c843d2 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.810623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.811300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.811629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.811954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.814970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.815567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.815876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.816146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.816778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:40.817073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.818428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.818687 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.820171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:40.840400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 234/466] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:40.840577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:40.841526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:40.842559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:40.843057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.843137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 233/467] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:40.843137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:40.858219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.946813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968409f-2da8-4ebf-9d40-56379a91309d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.950997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801547f1-716d-457a-832a-1facbf5dbeaf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:40.972135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:40.984502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.985041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.985315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.985580 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.985892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:40.986496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:40.986780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:40.987053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:40.987693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:40.988030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:40.989411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.005864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 234/468] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:41.005864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.070799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.073175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.080673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.112831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6d2c9-7f3e-42fd-9f96-89845d629a41 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.146375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.147639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.147908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.148175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.156195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.158044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:41.169871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:41.170788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 235/469] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:41.171689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.186406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 235/470] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:41.187308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.211817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.282033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4be09-d920-4ff5-a5a5-fc23f80b32e6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.288337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff0e9-bb44-4bd1-96e0-81fedf944a9c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.314231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.322519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.323149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.323428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.323699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.324441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:41.324747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.325371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.326016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.326215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.326311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.326562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.334223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.335764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.346665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 236/471] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:41.346665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:41.351602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:41.352468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:41.353341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 236/472] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:41.354318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.441624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.448746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c6d6-2ecf-4c86-b35d-810c8a881e1c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.461277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161492-3171-4e6a-a8d6-395529724180 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.482504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.483099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.483372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.483641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.484390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:41.484690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.486087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.494094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.494705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.494981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.495248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.502924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 237/473] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:41.503722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.505246 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.507295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:41.522893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:41.523973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:41.524851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:41.524851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:41.524851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:41.524851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 237/474] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:41.524851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.556615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.606358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac276b0-a7e4-4081-b9aa-e8f958ba419f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.621210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1633-ca97-4d67-b7d6-64a967ad8ea3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.639446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a1bac-1168-41e6-8fd3-4f900e1f7feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.640075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1bac-1168-41e6-8fd3-4f900e1f7feb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.640360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1bac-1168-41e6-8fd3-4f900e1f7feb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.640632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1bac-1168-41e6-8fd3-4f900e1f7feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.641356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1bac-1168-41e6-8fd3-4f900e1f7feb None admin] RBAC: Adding query filter params (role.id=4419e40f34ef48d3875a6b7cf51a528b, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=09fb6adedea24758bd852be1702cd1d4) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:41.641659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1bac-1168-41e6-8fd3-4f900e1f7feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.643082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1bac-1168-41e6-8fd3-4f900e1f7feb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.648764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 238/475] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/role_assignments?user.id=09fb6adedea24758bd852be1702cd1d4&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=4419e40f34ef48d3875a6b7cf51a528b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:41.649877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528753f6-a3a1-44e2-a26b-7b630a264e05 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.650160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528753f6-a3a1-44e2-a26b-7b630a264e05 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.650453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528753f6-a3a1-44e2-a26b-7b630a264e05 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.656193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 239/476] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:41.656193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528753f6-a3a1-44e2-a26b-7b630a264e05 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.658317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.658941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.659218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.659487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.660298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:41.660617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.662374 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.664785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.679982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 238/477] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:41.681936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:41.798261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528753f6-a3a1-44e2-a26b-7b630a264e05 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.805896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383131-3766-4cc2-be99-89f98b80ceaf None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:41.818706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.852052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.853001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.853123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.853545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.861018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0543f-a3bb-40de-8cab-29b4cb5d7234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:41.861637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0543f-a3bb-40de-8cab-29b4cb5d7234 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.861916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0543f-a3bb-40de-8cab-29b4cb5d7234 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.862186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0543f-a3bb-40de-8cab-29b4cb5d7234 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.862847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0543f-a3bb-40de-8cab-29b4cb5d7234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:41.863155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0543f-a3bb-40de-8cab-29b4cb5d7234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.864616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0543f-a3bb-40de-8cab-29b4cb5d7234 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.885980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 239/478] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:41.887569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d274-de7d-45b3-9798-34af58b1e4ed None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:41.887907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d274-de7d-45b3-9798-34af58b1e4ed None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:41.888187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d274-de7d-45b3-9798-34af58b1e4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:41.909264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f0e5d274-de7d-45b3-9798-34af58b1e4ed None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:41.910489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f0e5d274-de7d-45b3-9798-34af58b1e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:41.951968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:41.953697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:41.969281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:41.987958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 240/479] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:41.988714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5d274-de7d-45b3-9798-34af58b1e4ed None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.067235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 240/480] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:42.068115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.088853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:42.132496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5d274-de7d-45b3-9798-34af58b1e4ed None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.169645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.170254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.170532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.170799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.171525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] RBAC: Adding query filter params (role.id=4419e40f34ef48d3875a6b7cf51a528b, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=c01495a37066445293bdb957ece67e20) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:42.172377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:42.174121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:42.187841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 241/481] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:41 2022] GET /identity/v3/role_assignments?user.id=c01495a37066445293bdb957ece67e20&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=4419e40f34ef48d3875a6b7cf51a528b => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:42.187841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.194255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d68180-37b3-4e54-b614-297caaf638ea None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.242444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:42.267133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.268171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.268599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.269026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.277339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:42.278870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:42.291604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:42.292577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:42.293422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 241/482] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:42.294102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.320872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5098d-f524-4902-abfa-021b2cfeea10 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.372397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.373230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.373812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.374611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.392481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:42.394604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:42.396110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:42.411269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:42.412297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:42.413783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:42.413783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:42.413783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:42.416043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 242/483] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:42.417176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.425556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd6a03-f162-46a7-b590-b9535b26ff9f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.467432 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.468105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.468394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.468670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.480730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:42.486158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:42.487049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:42.487888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:42.492768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 242/484] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:42.493697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.543298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:42.547113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73203cd-f017-4cfa-93f1-cc4cb014d26b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.593070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.593927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.594862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.595290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.596197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:42.597116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:42.599279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:42.619838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 243/485] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:42.619838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.627482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749ce03-a328-4bb8-a05a-4c4401581487 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.677175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.677799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.678081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.678923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.679574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:42.679903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:42.681847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:42.683676 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:42.700824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 243/486] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:42.701901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.737492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465231-467e-4504-a259-9a7ee7ad609a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.774618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.775617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.776127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.776680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.777546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:42.778049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:42.779624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:42.790652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 244/487] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:42.796223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.822192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:42.834131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a95d-3c18-4cff-ba04-c0f84d0431a5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:42.874439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:42.875406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:42.875945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:42.876473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:42.877600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] RBAC: Adding query filter params (role.id=4419e40f34ef48d3875a6b7cf51a528b, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=ce79e1215c0345a59146c8bf6fe26cb7) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:42.878110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:42.879763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:42.886527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 244/488] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/role_assignments?user.id=ce79e1215c0345a59146c8bf6fe26cb7&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=4419e40f34ef48d3875a6b7cf51a528b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:42.887735 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:42.945046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0582-06ac-4291-ae0a-20c140c7249a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.004299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.005296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.005809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.006324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:43.014703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:43.016572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:43.026119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:43.036503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:43.037422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:43.038892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:43.045643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 245/489] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:43.054294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:43.114749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d85867-4913-4608-8f3b-afa49a23b805 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.158049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.158893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.159179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.159457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:43.161080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:43.174024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:43.175720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:43.183003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0254-8301-4f6b-a872-f67c1d0eac26 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:43.192918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:43.194775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:43.195643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:43.195643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:43.195643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:43.195643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 245/490] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:43.205204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:43.227537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.228961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.229557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.230053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:43.230994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:43.231520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:43.233256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:43.249137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 246/491] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:43.254721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:43.342104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d6b83-74b2-42ee-af7b-22cb4b3dc850 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.354503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:43.375703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c35e5-597b-4f92-8b77-b36cc848205c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.381787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.382706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.383217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.383691 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:43.384584 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:43.385090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:43.386665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:43.400173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 246/492] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:43.405878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:43.422641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.423157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.423442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.423716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:43.424486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] RBAC: Adding query filter params (role.id=4419e40f34ef48d3875a6b7cf51a528b, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=319b5538054c49d19ecc0b9c9cfc5b5b) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:43.424794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:43.426217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:43.438541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 247/493] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:43 2022] GET /identity/v3/role_assignments?user.id=319b5538054c49d19ecc0b9c9cfc5b5b&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=4419e40f34ef48d3875a6b7cf51a528b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:43.523507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce21ea-6fe9-45a3-8d6c-63f9d4d8ec58 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.562071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.563076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.563570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.564117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:43.573255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:43.575130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:43.588629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:43.589662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:43.590592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:43.593300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 247/494] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:43.599233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:43.609244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:43.750265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db32fa4-bd9a-4b72-87be-4fc47dd961db None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.790564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f8f85-f0b7-4e2d-8732-f03f395cb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.791180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8f85-f0b7-4e2d-8732-f03f395cb01e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.791464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8f85-f0b7-4e2d-8732-f03f395cb01e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.791741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8f85-f0b7-4e2d-8732-f03f395cb01e None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:43.792528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f8f85-f0b7-4e2d-8732-f03f395cb01e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:43.792837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f8f85-f0b7-4e2d-8732-f03f395cb01e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:43.794282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f8f85-f0b7-4e2d-8732-f03f395cb01e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:43.813396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 248/495] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 12 12:16:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:43.819613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:43.852289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:43.926038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a56794-905f-4afc-8796-0ed44326502d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:43.961914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57d3b3-968b-4d4b-bb6d-b10a088b5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:43.962529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d3b3-968b-4d4b-bb6d-b10a088b5582 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:43.962817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d3b3-968b-4d4b-bb6d-b10a088b5582 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:43.963092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d3b3-968b-4d4b-bb6d-b10a088b5582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.039050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57d3b3-968b-4d4b-bb6d-b10a088b5582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:44.040491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57d3b3-968b-4d4b-bb6d-b10a088b5582 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:44.072498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:44.144788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba874324-eb1b-4a43-8aa4-597b77153d67 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.145102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba874324-eb1b-4a43-8aa4-597b77153d67 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.145359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba874324-eb1b-4a43-8aa4-597b77153d67 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.145586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 248/496] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:16:44.146711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 249/497] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:44.153222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c0f0-ea72-4466-ba7e-1d993feeb1f7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.153404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba874324-eb1b-4a43-8aa4-597b77153d67 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:44.153639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c0f0-ea72-4466-ba7e-1d993feeb1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.153921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c0f0-ea72-4466-ba7e-1d993feeb1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.172681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bb99c0f0-ea72-4466-ba7e-1d993feeb1f7 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:44.173879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bb99c0f0-ea72-4466-ba7e-1d993feeb1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:44.277295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:44.285827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 249/498] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:44.344485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba874324-eb1b-4a43-8aa4-597b77153d67 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:44.394829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:44.395470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.395753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.396123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.412730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:44.414191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:44.430845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:44.431789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:44.433257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:44.433257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:44.433257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:44.433257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 250/499] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:44.437620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c0f0-ea72-4466-ba7e-1d993feeb1f7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:44.500635 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:44.555688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c0f0-ea72-4466-ba7e-1d993feeb1f7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:44.595289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:44.595845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.596134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.596410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.597057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:44.597362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:44.598750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:44.619120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 250/500] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:44.624632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:44.688921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:44.768992 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba8d2-ff43-4fa8-8c59-a3656d0b2da6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:44.800155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:44.834767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32c45-f66e-445a-9223-a70f25c8696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:44.835395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32c45-f66e-445a-9223-a70f25c8696f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.835673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32c45-f66e-445a-9223-a70f25c8696f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.835979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32c45-f66e-445a-9223-a70f25c8696f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.842787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32c45-f66e-445a-9223-a70f25c8696f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:44.844449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32c45-f66e-445a-9223-a70f25c8696f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-88b32c45-f66e-445a-9223-a70f25c8696f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:44.856312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:44.857169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 251/501] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:44.859030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cdcf-97f8-4db5-b2a4-4fa2da0c91ef None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.859581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afe057-6671-4182-9958-189747e4e6c3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:44.859656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cdcf-97f8-4db5-b2a4-4fa2da0c91ef None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.859656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cdcf-97f8-4db5-b2a4-4fa2da0c91ef None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.861810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 252/502] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:44.862891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824cdcf-97f8-4db5-b2a4-4fa2da0c91ef None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:44.886886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:44.903088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c32451-94a4-4997-9710-9cff50233d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:44.903723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32451-94a4-4997-9710-9cff50233d55 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.904290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32451-94a4-4997-9710-9cff50233d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.904567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c32451-94a4-4997-9710-9cff50233d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.917929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c32451-94a4-4997-9710-9cff50233d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:44.919395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c32451-94a4-4997-9710-9cff50233d55 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-40c32451-94a4-4997-9710-9cff50233d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:44.936058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:44.936978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:44.937948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:44.937948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:44.937948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:44.940725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 251/503] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:44.942139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d402-7ce7-4509-b9a3-8e3d0fb9ee6e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:44.942621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d402-7ce7-4509-b9a3-8e3d0fb9ee6e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:44.943065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d402-7ce7-4509-b9a3-8e3d0fb9ee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:44.964798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2111d402-7ce7-4509-b9a3-8e3d0fb9ee6e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:44.966719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2111d402-7ce7-4509-b9a3-8e3d0fb9ee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:44.987202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824cdcf-97f8-4db5-b2a4-4fa2da0c91ef None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:45.032261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:45.033256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.033612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.033960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.035148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:45.035530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:45.038197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:45.046649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 252/504] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:45.047695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d402-7ce7-4509-b9a3-8e3d0fb9ee6e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:45.061566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 253/505] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:45.067043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:45.110044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:45.182543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a2045-7b82-41bd-b673-9609d9972f5b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:45.218471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:45.219083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.219365 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.219743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.220628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] RBAC: Adding query filter params (role.id=4419e40f34ef48d3875a6b7cf51a528b, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=bc6e24255b28424ebb02c9319b40b25d) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:45.220943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:45.222379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:45.228841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 254/506] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:45 2022] GET /identity/v3/role_assignments?user.id=bc6e24255b28424ebb02c9319b40b25d&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=4419e40f34ef48d3875a6b7cf51a528b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:45.261006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d402-7ce7-4509-b9a3-8e3d0fb9ee6e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:45.263025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:45.322997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:45.323636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.323931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.324182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.324864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:45.325169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:45.326575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:45.340092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 253/507] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:45.345242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:45.385886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:45.487698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef897c7e-3a95-47cf-99f8-cba1c71e1581 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:45.496240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:45.520837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deae2db-cbee-4f3c-8c23-30137c3d8b54 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:45.527279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:45.527927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.528207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.528479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.529128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:45.531298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:45.557183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 255/508] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:16:45 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:45.569487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013143f-9431-42b3-b6c6-f91ff9b8510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:45.570203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013143f-9431-42b3-b6c6-f91ff9b8510f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.570486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013143f-9431-42b3-b6c6-f91ff9b8510f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.570753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013143f-9431-42b3-b6c6-f91ff9b8510f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.585640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013143f-9431-42b3-b6c6-f91ff9b8510f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8013143f-9431-42b3-b6c6-f91ff9b8510f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:45.591353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:45.592491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:45.593623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 254/509] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:45.601219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:45.751718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb342240-c72c-4406-8e54-8afb263abe84 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.754247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb342240-c72c-4406-8e54-8afb263abe84 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.754529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb342240-c72c-4406-8e54-8afb263abe84 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.757310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 255/510] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:45.765188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d992c-c6bd-4dcb-b418-b4186e714908 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.765471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d992c-c6bd-4dcb-b418-b4186e714908 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.765745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d992c-c6bd-4dcb-b418-b4186e714908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.773025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18698a-3a24-403b-bb85-b2837bd32973 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:45.792278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f19d992c-c6bd-4dcb-b418-b4186e714908 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:45.793475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f19d992c-c6bd-4dcb-b418-b4186e714908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:45.813187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:45.813803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.814083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.814352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:45.815011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:45.815313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:45.816720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:45.821382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:45.831843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 256/511] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:45.833587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:45.859704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:45.891982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 256/512] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:16:45.953182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220b19-8219-4a4e-89bf-aa6e2aab2cd6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:45.989308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:45.990283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:45.990730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:45.991193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.002640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:46.004384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:46.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:46.020623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:46.022283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:46.022283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:46.022283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:46.024061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 257/513] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:46.029529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d992c-c6bd-4dcb-b418-b4186e714908 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:46.132839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d992c-c6bd-4dcb-b418-b4186e714908 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:46.180727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:46.181661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.182150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.182601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.183421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:46.183937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:46.185499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:46.201549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 257/514] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:46.207128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:46.267361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:46.288200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:46.330783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:46.408089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39577b0-2f10-4aad-9c44-1e3ac0b9749c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:46.411310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190f8c-f17d-4092-a500-4884a99fef3f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:46.447112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8049c99-1d3b-446f-bab5-f11173db991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:46.447750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049c99-1d3b-446f-bab5-f11173db991d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.448043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049c99-1d3b-446f-bab5-f11173db991d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.448317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049c99-1d3b-446f-bab5-f11173db991d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.454090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa160ba-baa9-4e6b-91b8-69e24bd29500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:46.454937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa160ba-baa9-4e6b-91b8-69e24bd29500 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.455551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa160ba-baa9-4e6b-91b8-69e24bd29500 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.456128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa160ba-baa9-4e6b-91b8-69e24bd29500 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.456402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8049c99-1d3b-446f-bab5-f11173db991d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:46.457099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa160ba-baa9-4e6b-91b8-69e24bd29500 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:46.458070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8049c99-1d3b-446f-bab5-f11173db991d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:46.459024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa160ba-baa9-4e6b-91b8-69e24bd29500 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bfa160ba-baa9-4e6b-91b8-69e24bd29500 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:46.472151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:46.473207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:46.474076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 258/515] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Oct 12 12:16:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:46.475424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e189-fb1d-4c4b-a300-b1ba02dd3efa None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.480175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e189-fb1d-4c4b-a300-b1ba02dd3efa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.480175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e189-fb1d-4c4b-a300-b1ba02dd3efa None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.481321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 259/516] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f8049c99-1d3b-446f-bab5-f11173db991d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:46.481507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:46.482550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:46.483598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:46.484174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e189-fb1d-4c4b-a300-b1ba02dd3efa None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:46.485423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 258/517] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 12 12:16:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:46.486625 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809acd4-4106-4574-85a9-4456cda523a4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.486910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809acd4-4106-4574-85a9-4456cda523a4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.487189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809acd4-4106-4574-85a9-4456cda523a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.510426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e809acd4-4106-4574-85a9-4456cda523a4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:46.511240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e809acd4-4106-4574-85a9-4456cda523a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:46.578759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:46.595136 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 259/518] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:46.596432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809acd4-4106-4574-85a9-4456cda523a4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:46.641113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e189-fb1d-4c4b-a300-b1ba02dd3efa None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:46.668691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:46.706272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809acd4-4106-4574-85a9-4456cda523a4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:46.727746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:46.728400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.728682 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.728954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.729597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:46.729912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:46.731286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:46.743677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 260/519] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 12 12:16:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:46.748559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:46.749841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.750506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.751185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.752383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:46.752867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:46.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:46.757435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:46.793976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 260/520] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 12 12:16:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:46.797916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:46.941806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376e579-a152-40a6-a35f-a5d329afcb23 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:46.960930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f2be-163d-4fc8-94a1-0e66b0115770 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:46.961575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:46.981468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:46.982190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.982547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:46.982902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:46.997020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:46.998285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:46.998623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:46.999210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:46.999633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.000099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.000864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:47.001327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.002809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:47.010471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 261/521] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 12 12:16:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:47.011488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:47.018135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:47.022709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:47.023921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:47.024837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:47.024837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:47.024837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:47.029544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 261/522] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:47.030230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:47.217484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5fe1-b941-4aa6-9ad5-dda71f48ba37 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:47.229746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4247812-bc6f-4e85-9be2-fe002b2e0371 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:47.257132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:47.257834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:47.258116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.258386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] PATH_INFO: `/v3/services/network` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.259029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.260665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:47.272537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:47.273589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:47.274455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 262/523] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:47 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:47.279595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:47.279903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:47.280743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:47.281204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.281657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.282530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:47.283039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.286531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:47.304393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 262/524] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:47.310734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:47.353783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:47.359480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:47.400978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4a916-af50-43bf-9934-4bd28911db4d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:47.447979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:47.449476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:47.450021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.450493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.451345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] RBAC: Adding query filter params (name=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:47.451965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.453937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:47.455698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cc73f-76a9-41ab-8361-c07a1896be3c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:47.459919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 263/525] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:16:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:47.473006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:47.491902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:47.492527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:47.492811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.493084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.500257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.501595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:47.513431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:47.514340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:47.515266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 263/526] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:47.524989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:47.608180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a7ae9-6636-4ddd-bb65-28b3a5b93c38 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:47.660249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:47.672088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:47.672708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:47.674367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.674668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.675316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] RBAC: Adding query filter params (type=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:47.675631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.677050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:47.693182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 264/527] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:16:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:47.719117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db76bd9-6948-481e-bc3e-01a3f9d57424 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:47.728269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:47.762832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c30ccc-e277-406d-90f9-81028855f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:47.763468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c30ccc-e277-406d-90f9-81028855f5ce None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:47.763748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c30ccc-e277-406d-90f9-81028855f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.764050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c30ccc-e277-406d-90f9-81028855f5ce None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.764759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c30ccc-e277-406d-90f9-81028855f5ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:47.765068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c30ccc-e277-406d-90f9-81028855f5ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.766517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c30ccc-e277-406d-90f9-81028855f5ce None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:47.782877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 264/528] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:47.785905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:47.933743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052a5d-e633-4257-8ad1-f18b897f5519 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:47.972119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da9b98-c55d-498d-a6fd-b975d2a9c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:47.972794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da9b98-c55d-498d-a6fd-b975d2a9c284 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:47.973072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da9b98-c55d-498d-a6fd-b975d2a9c284 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:47.973346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da9b98-c55d-498d-a6fd-b975d2a9c284 None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/c01495a37066445293bdb957ece67e20/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:47.975974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da9b98-c55d-498d-a6fd-b975d2a9c284 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=c01495a37066445293bdb957ece67e20, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:47.977427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da9b98-c55d-498d-a6fd-b975d2a9c284 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:48.000247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 265/529] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:47 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/c01495a37066445293bdb957ece67e20/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:48.031295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26097ba0-f9de-4ade-8b8f-9219514e5625 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:48.031626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26097ba0-f9de-4ade-8b8f-9219514e5625 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:48.031893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26097ba0-f9de-4ade-8b8f-9219514e5625 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:48.033443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 265/530] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:48.039541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff691b1-30bf-44ed-a250-4e4bce0d5231 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:48.039918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff691b1-30bf-44ed-a250-4e4bce0d5231 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:48.040158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff691b1-30bf-44ed-a250-4e4bce0d5231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:48.062008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7ff691b1-30bf-44ed-a250-4e4bce0d5231 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:48.063256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7ff691b1-30bf-44ed-a250-4e4bce0d5231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:48.124361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:48.144174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 266/531] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:48.338622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05128-18a8-40c2-9475-e796c5547535 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:48.338945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05128-18a8-40c2-9475-e796c5547535 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:48.339190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05128-18a8-40c2-9475-e796c5547535 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:48.340846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 266/532] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:48.345983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06c56-ff8d-4e7a-bd22-10d94ec14604 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:48.346275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06c56-ff8d-4e7a-bd22-10d94ec14604 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:48.346556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06c56-ff8d-4e7a-bd22-10d94ec14604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:48.371429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cce06c56-ff8d-4e7a-bd22-10d94ec14604 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:48.372663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cce06c56-ff8d-4e7a-bd22-10d94ec14604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:48.427575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff05128-18a8-40c2-9475-e796c5547535 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:48.469091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 267/533] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:48.587531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff05128-18a8-40c2-9475-e796c5547535 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:48.664579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:48.665132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:48.665415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:48.665693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:48.696767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:48.701604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:48.702568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:48.703677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:48.709641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 267/534] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:48.710913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce06c56-ff8d-4e7a-bd22-10d94ec14604 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:48.848541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:48.865400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:48.943961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce06c56-ff8d-4e7a-bd22-10d94ec14604 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:48.979889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:49.015587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:49.017779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.018986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.019495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.020410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:49.020899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:49.023058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:49.031064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6ffe0-105e-4c6f-99e1-d60df9ccf9e6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:49.042318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 268/535] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:49.052537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:49.164579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:49.165234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.165518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.165793 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.208546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:49.213924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:49.214863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:49.215695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:49.216379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 268/536] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:49.232834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:49.309896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc22d85-8774-4c95-9a3b-7df77612c9c9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:49.360162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:49.376361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:49.377003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.377320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.377610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.400306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:49.401812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:49.420868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1eec7-8525-4a41-86be-e81fe714b7c5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:49.436082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:49.438431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:49.440569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:49.440569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:49.440569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:49.440569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 269/537] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:49.442724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:49.490829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:49.491357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.491637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.491940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.492611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:49.492912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:49.494297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:49.506801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:49.511184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 269/538] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:49.520793 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:49.626195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba850e-ec1c-443e-bd4e-e9a75d328a8c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:49.666601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4394a4-9074-4e32-a50b-20b6e59a1bda None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:49.697187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f4340-8fb5-4f79-919b-ce874ae27557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:49.697800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f4340-8fb5-4f79-919b-ce874ae27557 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.698081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f4340-8fb5-4f79-919b-ce874ae27557 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.698354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f4340-8fb5-4f79-919b-ce874ae27557 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.699002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f4340-8fb5-4f79-919b-ce874ae27557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:49.699304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f4340-8fb5-4f79-919b-ce874ae27557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:49.700908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f4340-8fb5-4f79-919b-ce874ae27557 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:49.703273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:49.704814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b990-6838-48a5-945e-a66d0432cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:49.705443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b990-6838-48a5-945e-a66d0432cb8a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.705724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b990-6838-48a5-945e-a66d0432cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.705997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b990-6838-48a5-945e-a66d0432cb8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.715052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 270/539] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:49.716712 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321dab-a5fd-4d35-a13a-d3efde5b1931 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.717282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321dab-a5fd-4d35-a13a-d3efde5b1931 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.717563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321dab-a5fd-4d35-a13a-d3efde5b1931 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.717965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b990-6838-48a5-945e-a66d0432cb8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:49.719586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b990-6838-48a5-945e-a66d0432cb8a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:49.722957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 271/540] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:49.723833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec321dab-a5fd-4d35-a13a-d3efde5b1931 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4943b990-6838-48a5-945e-a66d0432cb8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:49.738283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:49.739233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:49.740723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:49.740723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:49.740723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:49.740723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 270/541] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:49.741794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba453-7613-4b71-a18b-0b64cac5ea95 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.743330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba453-7613-4b71-a18b-0b64cac5ea95 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.743330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba453-7613-4b71-a18b-0b64cac5ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.764305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c5cba453-7613-4b71-a18b-0b64cac5ea95 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:49.765500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c5cba453-7613-4b71-a18b-0b64cac5ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:49.827006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:49.842764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec321dab-a5fd-4d35-a13a-d3efde5b1931 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:49.860344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 271/542] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:49.860344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cba453-7613-4b71-a18b-0b64cac5ea95 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:49.905136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:49.905772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:49.906053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:49.906329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:49.923506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:49.925171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:49.946579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:49.947598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:49.948596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 272/543] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:49.959615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.070150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cba453-7613-4b71-a18b-0b64cac5ea95 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.098161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:50.133037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752d01-748c-4d13-8561-6e63d204919e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.146715 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.147447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.147734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.148035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.148742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:50.149050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.150429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.173167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 272/544] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:50.177041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.194055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.195338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.195857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.196596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.197571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:50.197882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.199310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.217840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 273/545] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 12 12:16:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:50.223113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.234021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:50.314114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54981d-813c-4324-9055-79154e7853d4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.330761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3ae6b-ce2d-45fe-a526-955597223f46 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.350982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.351439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.351726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.352024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.360869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.362364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.372473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.373477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.373986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.374481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.375376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:50.375791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:50.376756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:50.377716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 273/546] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:16:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:50.378460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.380734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.402559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 274/547] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:16:50 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:50.409055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.419720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:50.503809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8d2d-354f-40b6-a8ba-5c70789a06f6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.522693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:50.552264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b367d-b103-4e0c-989c-f9e4bccba6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.553213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b367d-b103-4e0c-989c-f9e4bccba6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.553935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b367d-b103-4e0c-989c-f9e4bccba6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.554427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b367d-b103-4e0c-989c-f9e4bccba6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.568017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b367d-b103-4e0c-989c-f9e4bccba6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.569837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b367d-b103-4e0c-989c-f9e4bccba6c4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.574971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eebb4-27db-4a49-994c-032fb262873b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-282b367d-b103-4e0c-989c-f9e4bccba6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:50.586932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:50.587979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:50.588896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:50.588896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:50.588896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:50.590495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 274/548] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:50.596735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ece0c-2761-403a-9690-53452d066b9c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.597303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ece0c-2761-403a-9690-53452d066b9c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.597584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ece0c-2761-403a-9690-53452d066b9c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.603908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 275/549] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:50.603908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ece0c-2761-403a-9690-53452d066b9c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.623837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbfb77-57f9-479c-96b7-44b88b67f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.624219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb77-57f9-479c-96b7-44b88b67f51e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.624433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb77-57f9-479c-96b7-44b88b67f51e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.624705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb77-57f9-479c-96b7-44b88b67f51e None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.625465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfb77-57f9-479c-96b7-44b88b67f51e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:50.625771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfb77-57f9-479c-96b7-44b88b67f51e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.627234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfb77-57f9-479c-96b7-44b88b67f51e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.651276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 275/550] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 12 12:16:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:50.652471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6de79-320d-4cbd-bf3f-dd48991eee0c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.652777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6de79-320d-4cbd-bf3f-dd48991eee0c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.653053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6de79-320d-4cbd-bf3f-dd48991eee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.674200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-afb6de79-320d-4cbd-bf3f-dd48991eee0c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:50.675439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-afb6de79-320d-4cbd-bf3f-dd48991eee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:50.709831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:50.734744 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ece0c-2761-403a-9690-53452d066b9c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.768634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 276/551] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:50.769670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6de79-320d-4cbd-bf3f-dd48991eee0c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.785509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60150e-2abb-4b44-8cee-f93044cc361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.786120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60150e-2abb-4b44-8cee-f93044cc361e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.786407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60150e-2abb-4b44-8cee-f93044cc361e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.786697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60150e-2abb-4b44-8cee-f93044cc361e None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.787365 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60150e-2abb-4b44-8cee-f93044cc361e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:50.787669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60150e-2abb-4b44-8cee-f93044cc361e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.789149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60150e-2abb-4b44-8cee-f93044cc361e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.802326 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 276/552] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:50.808003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed1cb-8726-462a-a39a-bb8d6ced3f63 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.808003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed1cb-8726-462a-a39a-bb8d6ced3f63 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.808003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed1cb-8726-462a-a39a-bb8d6ced3f63 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.810151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 277/553] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:50.810943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed1cb-8726-462a-a39a-bb8d6ced3f63 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:50.859131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:50.919100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6de79-320d-4cbd-bf3f-dd48991eee0c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.923370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed1cb-8726-462a-a39a-bb8d6ced3f63 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:50.961072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18deeb-13f8-4b9a-bcb2-b75f7bd92428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.962116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18deeb-13f8-4b9a-bcb2-b75f7bd92428 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.962693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18deeb-13f8-4b9a-bcb2-b75f7bd92428 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.963210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18deeb-13f8-4b9a-bcb2-b75f7bd92428 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.965040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:50.965935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.966221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.966500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:50.971606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18deeb-13f8-4b9a-bcb2-b75f7bd92428 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.973336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18deeb-13f8-4b9a-bcb2-b75f7bd92428 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.978204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:50.979862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-bc18deeb-13f8-4b9a-bcb2-b75f7bd92428 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:50.985757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:50.986637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:50.987533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:50.994607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 278/554] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:50.995508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:50.996651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:50.997745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:50.997745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:50.997745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:50.998524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82c7b-94f9-4eef-b34a-295a05a4c768 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:50.998966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82c7b-94f9-4eef-b34a-295a05a4c768 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:50.999424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82c7b-94f9-4eef-b34a-295a05a4c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.001289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 277/555] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:51.002132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.007237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:51.021302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-42e82c7b-94f9-4eef-b34a-295a05a4c768 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:51.022812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-42e82c7b-94f9-4eef-b34a-295a05a4c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:51.091883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 279/556] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:16:51.093015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82c7b-94f9-4eef-b34a-295a05a4c768 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.133367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459072b-e66d-4524-9a37-2b253464aec6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.144283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:51.175903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:51.176884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:51.177385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:51.178393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.179351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:51.179917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:51.181719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:51.201102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 278/557] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:51.203335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.227465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82c7b-94f9-4eef-b34a-295a05a4c768 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.273011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:51.285028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:51.286197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:51.286688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:51.287935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.289689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:51.290184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:51.291790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:51.308105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 280/558] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:51.309148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.327650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96db47-cb7f-424d-975b-bee918297034 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.371470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:51.372202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:51.372555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:51.372836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.373495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:51.374915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:51.399968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 279/559] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:16:51 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:51.399968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.432812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d71ec-591f-428a-9f59-eb5ab18a99d3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.434022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:51.483760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:51.484652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:51.485108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:51.485431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/bc6e24255b28424ebb02c9319b40b25d/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.487764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=bc6e24255b28424ebb02c9319b40b25d, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:51.489366 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:51.511912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 281/560] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:51 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/bc6e24255b28424ebb02c9319b40b25d/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:16:51.513248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.567346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674435-a85f-4deb-956d-b92368b4d635 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.614805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:51.623756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:51.624718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:51.625198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:51.625687 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.635303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:51.637187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:51.650949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:51.652069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:51.653062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:51.655140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 280/561] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:51.660824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.681118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918675c-6b88-47cc-acd2-7f83682dd7b3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.734109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:51.734794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:51.734964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:51.735242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.747649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:51.753312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:51.754463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:51.755576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:51.763910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 282/562] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:51.765867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.784088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:51.800464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c7384-373f-4bdc-8d19-08a9420609f9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.843534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:51.844741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:51.845209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:51.845661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:51.846566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:51.847055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:51.849237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:51.864270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 281/563] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:51.871252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:51.945301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fab8-a5e0-47d3-aec5-7444fa227ace None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:51.963242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:52.010376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:52.011863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.012733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.013003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:52.013668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:52.015933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:52.017305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:52.029032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eed72-7712-4885-ad67-f9189aeb49a5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:52.034121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 283/564] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:52.040748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:52.078795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:52.079456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.079735 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.080036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/2b118893cb8e4542be3c02dd61648c61/roles/4419e40f34ef48d3875a6b7cf51a528b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:52.096689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=2b118893cb8e4542be3c02dd61648c61, role_id=4419e40f34ef48d3875a6b7cf51a528b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:52.098133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:52.108806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:52.123591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 282/565] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:16:51 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/2b118893cb8e4542be3c02dd61648c61/roles/4419e40f34ef48d3875a6b7cf51a528b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:16:52.167277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2b9f-b298-41a6-be9b-be4702a9bb5b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:52.212660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:52.213682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.214180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.214733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:52.227834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:52.229692 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:52.246020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:52.247064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:52.248002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:52.248002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:52.248002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:52.250227 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 284/566] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:52.256247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:52.389312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560db9b-e4a2-4c7b-b042-7b3d71fe1a00 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:52.440147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:52.441118 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.441609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.442119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:52.443025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:52.443551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:52.445158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:52.463296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 283/567] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:52.469351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:52.496205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:52.603091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88dc0f-751b-4600-8af8-b99dfa9346eb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:52.641172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:52.641828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.642111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.642422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:52.651332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:52.652873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:52.665205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:52.666226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:52.667934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 285/568] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 12 12:16:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:52.672036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:52.751391 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:52.813484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681cafe-3162-442a-913b-767267d806c5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:52.854112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b385b47-9853-4391-b470-81acfd1b6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:52.854734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b385b47-9853-4391-b470-81acfd1b6b99 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.855017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b385b47-9853-4391-b470-81acfd1b6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.855294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b385b47-9853-4391-b470-81acfd1b6b99 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:52.856081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b385b47-9853-4391-b470-81acfd1b6b99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:52.856390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b385b47-9853-4391-b470-81acfd1b6b99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:52.857860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b385b47-9853-4391-b470-81acfd1b6b99 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:52.878299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 284/569] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 12 12:16:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:52.884573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:52.988387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff975-6dd5-4399-b8cf-79de31aac829 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.988724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff975-6dd5-4399-b8cf-79de31aac829 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.988951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ff975-6dd5-4399-b8cf-79de31aac829 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:52.991108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 285/570] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:16:52.996515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffe32-0a2b-4c42-80c3-9100a3c7489a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:52.996801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffe32-0a2b-4c42-80c3-9100a3c7489a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:52.997079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffe32-0a2b-4c42-80c3-9100a3c7489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:53.014646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:53.022781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5ecffe32-0a2b-4c42-80c3-9100a3c7489a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:53.024162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5ecffe32-0a2b-4c42-80c3-9100a3c7489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:53.050000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022817e1-3277-44a2-92e3-763a6d27aeeb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:53.101033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:53.101939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:53.102532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:53.102980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:53.121462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 286/571] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:16:53.176026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:53.177826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:53.266020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:53.286738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 286/572] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:16:53.292336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecffe32-0a2b-4c42-80c3-9100a3c7489a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:53.367766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:53.439404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecffe32-0a2b-4c42-80c3-9100a3c7489a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:53.477742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:53.487093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:53.487479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:53.487763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:53.488063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:53.507869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:53.509326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:53.532482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:53.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:53.535059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:53.535059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:53.535059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:53.535059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 287/573] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:53.539236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:53.586885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f4f7-3ee7-4bf5-aa07-03d81ffdfdea None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:53.622904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:53.623938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:53.624433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:53.624917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:53.625747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:53.627318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:53.638222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:53.639226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:53.640101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:53.647511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 287/574] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Oct 12 12:16:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:53.648952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:53.675022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:53.679313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0c9a9-a1df-44f6-9708-75ebd5bdb687 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:53.700180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:53.714805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:53.715419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:53.715756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:53.716013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:53.716725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:53.717053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:53.718442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:53.731101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 288/575] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:53.736517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:53.758034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c76a9-30fe-44fc-b0c8-31fc187cbc73 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:53.794238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:53.795129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:53.795606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:53.796206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:53.797033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:53.797530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:53.799157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:53.816418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 288/576] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 12 12:16:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:53.822296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:53.842427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb56ef3-1336-4b04-a753-e3936c9fbfb5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:53.881542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:53.882382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:53.882664 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:53.882937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:53.897125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:53.898595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:53.920075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:53.921018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:53.921989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:53.924563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 289/577] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:53.930275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:53.953150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:54.021644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570b072-3cc5-47d4-92aa-df8ef3ec7cfe None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:54.035755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436647eb-a9cf-42dd-bde5-63091efd07ef None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:54.043830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:54.064591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:54.065514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.066040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.066487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.067289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:54.067767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:54.069593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:54.073964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:54.074584 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.074957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.075349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.076148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:54.076522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:54.079829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:54.080111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 289/578] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 12 12:16:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:54.084496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:54.093620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 290/579] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:54.100002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:54.192155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1158ac-b50c-447c-b56e-7e39bdb11d5b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:54.234987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:54.236011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.236495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.236988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.237975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] RBAC: Adding query filter params (interface=public, service_id=7fa633e39e194f579cae368114c46992, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:54.239595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:54.241293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:54.241848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:54.255660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 290/580] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:16:54 2022] GET /identity/v3/endpoints?service_id=7fa633e39e194f579cae368114c46992&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:54.261944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:54.282147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0aa3a-d34f-45e1-adce-f0e92d0dd8fd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:54.345995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:54.358464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b87af-815e-4a7f-968b-7518dd202aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:54.359075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b87af-815e-4a7f-968b-7518dd202aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.359356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b87af-815e-4a7f-968b-7518dd202aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.359630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b87af-815e-4a7f-968b-7518dd202aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.360397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b87af-815e-4a7f-968b-7518dd202aa9 None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=c01495a37066445293bdb957ece67e20) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:54.360709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b87af-815e-4a7f-968b-7518dd202aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:54.362138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b87af-815e-4a7f-968b-7518dd202aa9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:54.375851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 291/581] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:54 2022] GET /identity/v3/role_assignments?user.id=c01495a37066445293bdb957ece67e20&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:54.445404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f9041-0152-4af1-995c-fdf86eb7a8f1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:54.461971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb52841-d294-41f2-8b06-39fe11671a19 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.462170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb52841-d294-41f2-8b06-39fe11671a19 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.462472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb52841-d294-41f2-8b06-39fe11671a19 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.464274 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 292/582] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:16:54.473211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba4ad-098a-4d0b-b40b-91044b0e5dec None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.473515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba4ad-098a-4d0b-b40b-91044b0e5dec None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.473774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba4ad-098a-4d0b-b40b-91044b0e5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.493052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32018e2c-1a46-4393-87b0-214118e12a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:54.494086 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018e2c-1a46-4393-87b0-214118e12a67 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.494567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018e2c-1a46-4393-87b0-214118e12a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.495039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32018e2c-1a46-4393-87b0-214118e12a67 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.495888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018e2c-1a46-4393-87b0-214118e12a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:54.497589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32018e2c-1a46-4393-87b0-214118e12a67 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:54.509550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 291/583] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:16:54 2022] GET /identity/v3/services => generated 772 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:54.510939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b6cba4ad-098a-4d0b-b40b-91044b0e5dec None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:54.512423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b6cba4ad-098a-4d0b-b40b-91044b0e5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:54.571182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2170a-d8c1-4c4f-bb6c-e4b159e1f0ac None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.571963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2170a-d8c1-4c4f-bb6c-e4b159e1f0ac None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.572465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2170a-d8c1-4c4f-bb6c-e4b159e1f0ac None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.574025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 292/584] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:16:54.583091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f0cd-b5f2-430a-807b-65ce5ccc35a9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.583785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f0cd-b5f2-430a-807b-65ce5ccc35a9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.584301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f0cd-b5f2-430a-807b-65ce5ccc35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.606591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1d84f0cd-b5f2-430a-807b-65ce5ccc35a9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:54.608182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1d84f0cd-b5f2-430a-807b-65ce5ccc35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:54.642748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 293/585] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:16:54.695930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 293/586] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:16:54.758360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce645e-9d19-4920-bd7e-0c9e46f6235b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.758888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce645e-9d19-4920-bd7e-0c9e46f6235b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.758888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce645e-9d19-4920-bd7e-0c9e46f6235b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.760558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 294/587] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:54.765897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2003c-2570-4fde-9938-fe8ec753e41a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:54.766443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2003c-2570-4fde-9938-fe8ec753e41a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:54.766938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2003c-2570-4fde-9938-fe8ec753e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:54.788115 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b1d2003c-2570-4fde-9938-fe8ec753e41a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:54.789307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b1d2003c-2570-4fde-9938-fe8ec753e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:54.815939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:54.872628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 294/588] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:16:55.006935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce645e-9d19-4920-bd7e-0c9e46f6235b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.014178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2003c-2570-4fde-9938-fe8ec753e41a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.125894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2003c-2570-4fde-9938-fe8ec753e41a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.127983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:55.154165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce645e-9d19-4920-bd7e-0c9e46f6235b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.191415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.192097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.192383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.192663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] PATH_INFO: `/v3/services/network` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.193792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.195219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:55.205574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:55.206704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:55.207610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 295/589] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:55.216183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.227376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.228497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.229035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.229509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.241378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:55.246288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:55.247213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:16:55.248092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:55.252287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 295/590] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:16:55.253176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.280878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:55.329863 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576d59-cbfd-49d5-b527-5d67aa984d4e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.356541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b49b7-c5fe-4993-9a73-63fd60bfac76 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.366771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.367853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.368367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.368845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.369695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] RBAC: Adding query filter params (name=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:55.370299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.372076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.380812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:55.382776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 296/591] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:55.383896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.392787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.393429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.393760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.394036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.405960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:16:55.410879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:55.412120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 296/592] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:55.413123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.497427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eff48-cadd-4e34-9ff9-4f0e4962a6cb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.502935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:55.522229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242cfbd-fd26-4434-91c6-8465e4904835 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.535513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.536337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.536833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.537224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.538010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:55.538425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.540142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.550300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 297/593] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:55.551473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.569499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.570132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.570412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.570686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.571351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] RBAC: Adding query filter params (type=network) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:55.571625 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.573049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.578594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 297/594] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:55.579489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.624481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:55.666798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba7ba-1461-4ab0-9806-a3bfc67ced60 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.678187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284ff63-cb9b-4570-93d6-f9abe3098813 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.704027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.705107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.705594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.706085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.707052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:55.707648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.709363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.712203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.712811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.713095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.713367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.719748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 298/595] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:55.720858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.728290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.729900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.736882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:55.745879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:55.747041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:55.748191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:55.748191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:55.748191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:55.749880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 298/596] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:55.761226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.837895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028813b-10ce-4cbb-acf9-77a7078b8806 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.863508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:55.868551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3624756-cb68-461b-8123-d5d52fb3ef06 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:55.877618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.878530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.878961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.879384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.880403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] RBAC: Adding query filter params (interface=public, service_id=1850253c5f1e433787ac7e6f5e4f44b7, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:55.880865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.882739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.893030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 299/597] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/endpoints?service_id=1850253c5f1e433787ac7e6f5e4f44b7&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:55.894145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.904578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:55.905301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:55.905652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:55.906013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:55.918172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:55.919892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:55.935235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:55.936284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:55.937226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:55.937226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:55.937226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:55.937226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 299/598] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:55.937226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:55.993908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:56.012063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3eb58b-42cb-4d42-bd6d-5610e7f4a60e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.048864 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551790-ee80-49a5-b711-73b7ee5a46af None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.050851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.051769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.052974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.053475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.054357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:56.054873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.056505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:56.069250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 300/599] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:56.070427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:56.089525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.090135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.090416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.090689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.091301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.092954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:56.098815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 300/600] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:16:55 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:56.100260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:56.128699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:56.200840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6127-cc30-4fb2-8f22-7094483befb7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.230480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691a106-b201-4e0d-866f-5975659e8616 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.241149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.242219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.242703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.243171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.244088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:56.244695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.245691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:56.247705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:56.263099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 301/601] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:56.269308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:56.272983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.273689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.273907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.274181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.282670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.284139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:56.305323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:56.306345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:56.307335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 301/602] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:16:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:56.317019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:56.395440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9496-0f1a-4dc7-aaa4-4e5c724857d2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.408881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:56.437769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.438519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.438924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.439274 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.447478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.449124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:16:56.463281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:56.464740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:56.466002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 302/603] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:16:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:56.471484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd83f1-c9d7-48d4-9b98-14aeb2bf1a98 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.472792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:56.524793 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.525409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.525686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.525957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.526695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:56.526996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.528592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:56.560054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 302/604] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Oct 12 12:16:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:56.569480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:56.635043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:56.649922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de36b-db6f-4d17-877b-64d772c258bc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.710710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.711331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.711609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.711903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.712654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:56.712967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.714458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:56.738889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 303/605] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 12 12:16:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:56.744832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:56.785445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e006c0-251c-4624-a0c9-2e79c84b009f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.800164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:56.853761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bb58a-0091-46db-81dd-2418205aeec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.854693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bb58a-0091-46db-81dd-2418205aeec2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.855135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bb58a-0091-46db-81dd-2418205aeec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.855568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bb58a-0091-46db-81dd-2418205aeec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.929781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5523-b29b-4d89-a708-1559ed1b42ac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:56.966640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f8548-0c2a-4f8e-bce1-33ce16847283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:56.967490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8548-0c2a-4f8e-bce1-33ce16847283 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:56.967978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8548-0c2a-4f8e-bce1-33ce16847283 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:56.968414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8548-0c2a-4f8e-bce1-33ce16847283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:56.969327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bb58a-0091-46db-81dd-2418205aeec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:56.970933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bb58a-0091-46db-81dd-2418205aeec2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.003102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.042334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f8548-0c2a-4f8e-bce1-33ce16847283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.044092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f8548-0c2a-4f8e-bce1-33ce16847283 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.072141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.084888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 303/606] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 12 12:16:57.086347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075ae1-46ac-4ac3-84a7-74caa778fb7d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.086731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075ae1-46ac-4ac3-84a7-74caa778fb7d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.087103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075ae1-46ac-4ac3-84a7-74caa778fb7d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.091912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 304/607] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:57.093099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075ae1-46ac-4ac3-84a7-74caa778fb7d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.154563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 304/608] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:16:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:16:57.156104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710d96-2299-45ab-9038-b6ccc02b544d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.156550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710d96-2299-45ab-9038-b6ccc02b544d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.156981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710d96-2299-45ab-9038-b6ccc02b544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.175810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f8710d96-2299-45ab-9038-b6ccc02b544d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:57.177376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f8710d96-2299-45ab-9038-b6ccc02b544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:57.208067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075ae1-46ac-4ac3-84a7-74caa778fb7d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.240926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.247204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0d229-37ae-4104-93a6-d357d49e9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:57.247851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0d229-37ae-4104-93a6-d357d49e9b8a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.248127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0d229-37ae-4104-93a6-d357d49e9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.248417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0d229-37ae-4104-93a6-d357d49e9b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.255861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 305/609] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:16:57.255861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710d96-2299-45ab-9038-b6ccc02b544d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.259488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0d229-37ae-4104-93a6-d357d49e9b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.261038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0d229-37ae-4104-93a6-d357d49e9b8a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-1aa0d229-37ae-4104-93a6-d357d49e9b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:57.282677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:57.284005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:57.285082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:57.285082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:57.285082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:57.285082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 305/610] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:57.285337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923335b-1778-41e3-8896-4062a402e135 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.285531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923335b-1778-41e3-8896-4062a402e135 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.285805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923335b-1778-41e3-8896-4062a402e135 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.288108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 306/611] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:57.293052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ba2b-ada9-4a7d-b7ee-d5ab9659df3a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.293437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ba2b-ada9-4a7d-b7ee-d5ab9659df3a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.293984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ba2b-ada9-4a7d-b7ee-d5ab9659df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.313352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ebd9ba2b-ada9-4a7d-b7ee-d5ab9659df3a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:57.314644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ebd9ba2b-ada9-4a7d-b7ee-d5ab9659df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:57.319665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.369586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710d96-2299-45ab-9038-b6ccc02b544d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.401242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 307/612] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:16:57.402566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9ba2b-ada9-4a7d-b7ee-d5ab9659df3a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.409059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:57.409726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.410011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.410279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.421462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.422957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:16:57.438661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:57.439688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:16:57.440651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:16:57.440651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:16:57.440651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:57.440651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 306/613] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:57.446145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.577129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9ba2b-ada9-4a7d-b7ee-d5ab9659df3a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.604414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.612940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca6be8-a2cd-42e1-8f9c-af7f289d527f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.623043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.639046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:57.640651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.641155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.641888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.643669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:57.644217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.647207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.650678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:57.651275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.651552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.651852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.652546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:57.652851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.654192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.662882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 308/614] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:57.664779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.666828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 307/615] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:16:57.672168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.779961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39873-2d7d-48e0-a3b1-14f02626f546 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.787191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54d68-a576-4aba-90e9-2d853a1cbbfb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.814509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:57.815128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.815403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.815672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.816285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.818374 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.823502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:57.824167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.824449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.824780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:57.826832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:57.828190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:57.829093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 309/616] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:57.829939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.838093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.840016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:57.853110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:57.854058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 308/617] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:57.860209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:57.877123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.889899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:57.940643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b1fc8-ccfb-4457-92e2-5f6184c0bff7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.968405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5430-ce3d-4f39-b82e-3b21735517ba None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:57.981878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:57.982613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:57.982893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:57.983165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:57.990559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:57.992025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:16:58.003084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:58.004022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:16:58.004959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:16:58.005970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.005970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.005970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.005970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.006284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.007192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.009559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 310/618] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:58.010257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:58.016281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:58.017260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:16:58.018189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:58.022225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 309/619] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 12 12:16:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:58.023054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.112201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:58.117684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08e2c1-8d1e-4ba8-9c12-40fa75a5093e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.119842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:58.129187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08198f83-2bbf-4e70-9987-8cab8bf571d8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.153195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.153962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.154072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.154337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.154962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.155270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.156663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.161287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 311/620] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.166897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.167248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.168116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.168607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.169067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.171146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.171640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.173271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.190271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 310/621] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.191585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.271120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b43914-b428-47c6-8bb2-9912686c07ef None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.298936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87c3e-0a11-441d-a1c7-bc1f2ee93049 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.303923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.304528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.304808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.305082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.305767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.306076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.307494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.319772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 312/622] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.320648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.343421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.344537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.345171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.345455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.346180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.346498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.347966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.351517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:58.354456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 311/623] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.355328 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.375228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:58.433333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f473d8-e8fd-4794-b8b5-9c50ba7f842a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.465238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3edaae-399c-4d86-bb6e-b91a93601727 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.468691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.469293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.469574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.469847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.470477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.470779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.472183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.476874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 313/624] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.477641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.502369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.502972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.503251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.503524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.504291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=bc6e24255b28424ebb02c9319b40b25d) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.504600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.506649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.512288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 312/625] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/role_assignments?user.id=bc6e24255b28424ebb02c9319b40b25d&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.513054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.563745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:58.581827 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359ca6c-7073-4371-aaa4-a46766dbf010 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.616077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:58.620973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543a61b-2ad4-46d7-8554-fbe770441409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.621679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a61b-2ad4-46d7-8554-fbe770441409 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.621962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a61b-2ad4-46d7-8554-fbe770441409 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.622233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543a61b-2ad4-46d7-8554-fbe770441409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.622983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543a61b-2ad4-46d7-8554-fbe770441409 None admin] RBAC: Adding query filter params (role.id=4419e40f34ef48d3875a6b7cf51a528b, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=2b118893cb8e4542be3c02dd61648c61) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.623287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543a61b-2ad4-46d7-8554-fbe770441409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.624770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543a61b-2ad4-46d7-8554-fbe770441409 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.631918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 314/626] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/role_assignments?user.id=2b118893cb8e4542be3c02dd61648c61&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=4419e40f34ef48d3875a6b7cf51a528b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.633026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5134d2-ad7d-44e5-8af3-d8e79483a3cd None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.633313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5134d2-ad7d-44e5-8af3-d8e79483a3cd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.633584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5134d2-ad7d-44e5-8af3-d8e79483a3cd None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.635030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 315/627] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:16:58.635604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5134d2-ad7d-44e5-8af3-d8e79483a3cd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:58.658591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34fa2-7db2-46af-91bf-046c66100117 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.712218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf3445-7120-43ad-8f32-fec6805632c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.712856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3445-7120-43ad-8f32-fec6805632c2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.713141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3445-7120-43ad-8f32-fec6805632c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.713416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf3445-7120-43ad-8f32-fec6805632c2 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.714066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3445-7120-43ad-8f32-fec6805632c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:58.714374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3445-7120-43ad-8f32-fec6805632c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.715782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf3445-7120-43ad-8f32-fec6805632c2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.721193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 313/628] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:16:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:58.722514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d663fc1-5046-42b7-9014-4cd0dfa436d9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.722805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d663fc1-5046-42b7-9014-4cd0dfa436d9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.723085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d663fc1-5046-42b7-9014-4cd0dfa436d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.745723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2d663fc1-5046-42b7-9014-4cd0dfa436d9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:16:58.747002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2d663fc1-5046-42b7-9014-4cd0dfa436d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:16:58.801341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5134d2-ad7d-44e5-8af3-d8e79483a3cd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:58.867849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:58.868739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:58.869022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:58.869740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:58.870704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:58.872148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:58.874266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 314/629] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:16:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:16:58.900318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 316/630] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:16:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:16:59.175444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d663fc1-5046-42b7-9014-4cd0dfa436d9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:59.254612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:59.281994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d663fc1-5046-42b7-9014-4cd0dfa436d9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:59.329598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:59.330254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:59.330537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:59.330807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] PATH_INFO: `/v3/services/network` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:59.331390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:59.332787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:16:59.342856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:16:59.343874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:16:59.344739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 315/631] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:16:59 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:16:59.350734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:59.360735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:59.465543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648c7a-1883-4210-9a15-103c609b0194 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:59.512022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:59.512640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:59.512925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:59.513200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:59.513838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:59.514151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:59.515522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:59.524342 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 317/632] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:16:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:59.530213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:59.655280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f65a-d61b-4f89-808c-c6eedcecd855 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:59.699746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df24c5-867e-42f2-8968-8330823080c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:59.700419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df24c5-867e-42f2-8968-8330823080c9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:59.700701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df24c5-867e-42f2-8968-8330823080c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:59.701026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df24c5-867e-42f2-8968-8330823080c9 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:59.701672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df24c5-867e-42f2-8968-8330823080c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:16:59.701974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df24c5-867e-42f2-8968-8330823080c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:59.703608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df24c5-867e-42f2-8968-8330823080c9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:59.704962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:59.715958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 316/633] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:16:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:16:59.721485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:16:59.805056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:16:59.854294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efbe61-b5d7-4b3f-8cee-14f4768e96e1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:16:59.899571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd68ffb-8464-4fb4-9ba2-31a87ab1e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:16:59.900560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd68ffb-8464-4fb4-9ba2-31a87ab1e7f5 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:16:59.901047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd68ffb-8464-4fb4-9ba2-31a87ab1e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:16:59.901565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd68ffb-8464-4fb4-9ba2-31a87ab1e7f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:16:59.902494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd68ffb-8464-4fb4-9ba2-31a87ab1e7f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:16:59.904121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd68ffb-8464-4fb4-9ba2-31a87ab1e7f5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:16:59.934451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 318/634] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:16:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:00.945387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf887-c7d1-4c13-849c-2103e92cae72 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:00.946436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf887-c7d1-4c13-849c-2103e92cae72 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:00.946944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf887-c7d1-4c13-849c-2103e92cae72 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:00.948779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 317/635] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:00.957471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aeb97-19e3-4365-88dd-02deffdcf148 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:00.958795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aeb97-19e3-4365-88dd-02deffdcf148 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:00.959293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aeb97-19e3-4365-88dd-02deffdcf148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:00.978628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-500aeb97-19e3-4365-88dd-02deffdcf148 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:00.980201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-500aeb97-19e3-4365-88dd-02deffdcf148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:01.060869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 319/636] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:01.196661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ba3cb-8523-4ae6-9964-2a1470cb3bb8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.196996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ba3cb-8523-4ae6-9964-2a1470cb3bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.197226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ba3cb-8523-4ae6-9964-2a1470cb3bb8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.198959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 318/637] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:01.205226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b938260-e2d6-48b2-82ff-3e5ddae5ba5a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.205537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b938260-e2d6-48b2-82ff-3e5ddae5ba5a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.205785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b938260-e2d6-48b2-82ff-3e5ddae5ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.225861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0b938260-e2d6-48b2-82ff-3e5ddae5ba5a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:01.227053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0b938260-e2d6-48b2-82ff-3e5ddae5ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:01.276899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:01.308029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 320/638] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:01.310654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994b09-15e9-4742-a4cf-402c816bf9ac None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.310980 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994b09-15e9-4742-a4cf-402c816bf9ac None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.311217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994b09-15e9-4742-a4cf-402c816bf9ac None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.312809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 319/639] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:01.318303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e976-d42a-47aa-b8ff-17fd0fa0851c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.318593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e976-d42a-47aa-b8ff-17fd0fa0851c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.318867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e976-d42a-47aa-b8ff-17fd0fa0851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.337650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-79b3e976-d42a-47aa-b8ff-17fd0fa0851c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:01.338823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-79b3e976-d42a-47aa-b8ff-17fd0fa0851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:01.341855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2994b09-15e9-4742-a4cf-402c816bf9ac None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:01.420369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 321/640] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:01.453006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2994b09-15e9-4742-a4cf-402c816bf9ac None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:01.490303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:01.491182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.491609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.492047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.492781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:01.494395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:01.503609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:01.504829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:01.505909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:01.508323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 320/641] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:01.513930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e976-d42a-47aa-b8ff-17fd0fa0851c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:01.587529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:01.621232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e976-d42a-47aa-b8ff-17fd0fa0851c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:01.635910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:01.659472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:01.660426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.660889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.662036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:01.662690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.663582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:01.664114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:01.665559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:01.674913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 322/642] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:01.676743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:01.712573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c00dfd-e9b4-4d2b-9e08-1ba1186e494f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:01.750993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:01.752646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.753433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.753927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.755269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:01.756758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:01.779852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 321/643] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:01 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:17:01.779852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:01.806994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d77a03-eacb-49cc-a0c4-3ac682d82845 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:01.859901 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28797c1a-b012-48fe-a176-8aa7a142ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:01.860436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28797c1a-b012-48fe-a176-8aa7a142ae6a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.860717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28797c1a-b012-48fe-a176-8aa7a142ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.860987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28797c1a-b012-48fe-a176-8aa7a142ae6a None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.861636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28797c1a-b012-48fe-a176-8aa7a142ae6a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:01.861941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28797c1a-b012-48fe-a176-8aa7a142ae6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:01.863342 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28797c1a-b012-48fe-a176-8aa7a142ae6a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:01.871897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 323/644] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:01.873835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9197e-c21c-4972-a11b-6a06cd5e9dad None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.874373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9197e-c21c-4972-a11b-6a06cd5e9dad None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.874847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9197e-c21c-4972-a11b-6a06cd5e9dad None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.877757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 324/645] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:01.884147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8273e-53c0-46ee-a771-fade75208a30 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.884496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8273e-53c0-46ee-a771-fade75208a30 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.884751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8273e-53c0-46ee-a771-fade75208a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.905131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-66d8273e-53c0-46ee-a771-fade75208a30 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:01.906400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-66d8273e-53c0-46ee-a771-fade75208a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:01.919610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e546b-de95-4b2e-8553-4983a32ab15f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:01.941532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:01.959619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:01.978146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:01.979454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:01.980436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:01.981128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:01.995929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 325/646] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:01.998085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:02.003731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:02.005491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:02.006530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:02.008986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 322/647] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 12 12:17:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:02.015268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8273e-53c0-46ee-a771-fade75208a30 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.122039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8273e-53c0-46ee-a771-fade75208a30 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.158409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.159019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.159300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.159577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.160287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:02.160637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.162115 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.170816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 326/648] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:02.175971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.267483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.284713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2905-4e88-451e-ad2e-864444cc2fa2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.296998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:02.331670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.332654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.333033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.333314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.349213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.350745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:02.372615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:02.373578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:02.374478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:02.374478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:02.374478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:02.374478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 323/649] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:02.379319 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.384255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6029fd2-bf34-4389-830f-05f9f4d6d5df None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.416939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:02.419848 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.420775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.421400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.421867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.422672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.424354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:02.434322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:02.435331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:02.436223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:02.438959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 327/650] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:02.448224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.492155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d755ea-6c2f-48d3-a6ff-06023456633f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.535949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.536953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.537304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.537646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.538628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:02.539005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.541209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.549664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:02.560551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0590-3cd1-4637-b0ff-dcfd78113638 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.561057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 324/651] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:02.568487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.605070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.605687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.605970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.606241 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.607032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:02.607341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.608907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.615093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 328/652] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:02.621299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.692801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:02.701078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c1f02-3ad6-4497-9ffc-f6b91092b5a0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.737605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.738631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.739237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.740250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.747729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.748488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcfaf2-c60f-42a1-ae5e-7952e4db6b6d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.749707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:17:02.766500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:02.767632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:02.773186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 325/653] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:02.778814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:02.795366 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.796149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.796436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.796712 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.797440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:02.797753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.799357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.807883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 329/654] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:02.902596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d52ce-f662-4f0d-9ff0-316295b5f5cc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:02.940576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:02.941197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:02.941478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:02.941751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:02.942538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:02.942898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:02.944331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:02.972369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 326/655] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:02.984113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:03.013983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:03.101856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52562a72-6375-4a92-acac-253e1c77c927 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:03.136484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:03.137116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:03.137397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:03.137670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:03.149203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:03.150708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:03.165855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:03.166834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:03.167724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:03.167724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:03.167724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:03.167724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 330/656] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:03.172947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:03.188377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:03.279343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ed509-2296-4437-8fd3-ce72cf2f4f1e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:03.315774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:03.316407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:03.316687 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:03.316959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:03.317634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:03.317935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:03.319311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:03.331322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 327/657] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:03.337134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:03.409523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:03.440835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660b730-7c3c-4dce-a20a-03f8fb3644f8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:03.477510 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:03.478147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:03.478427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:03.478698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:03.485591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:03.487029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:17:03.498417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:03.500466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:03.502476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 331/658] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:03.508876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:03.588982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:03.624489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb80e9-6a53-4adb-ba74-5becd9051270 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:03.660104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bad18-ad76-4ab1-b532-ca9df8422b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:03.661616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bad18-ad76-4ab1-b532-ca9df8422b5c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:03.662111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bad18-ad76-4ab1-b532-ca9df8422b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:03.662559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bad18-ad76-4ab1-b532-ca9df8422b5c None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:03.663404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bad18-ad76-4ab1-b532-ca9df8422b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:03.663876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bad18-ad76-4ab1-b532-ca9df8422b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:03.665573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bad18-ad76-4ab1-b532-ca9df8422b5c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:03.678957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 328/659] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:03.684969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:03.791750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac0ec3-fe4a-4311-866e-f3d4c4dc626e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:03.821290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:03.827827 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097af9aa-87dc-4786-ba35-95520bc1913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:03.828501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097af9aa-87dc-4786-ba35-95520bc1913f None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:03.828785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097af9aa-87dc-4786-ba35-95520bc1913f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:03.829068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097af9aa-87dc-4786-ba35-95520bc1913f None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/2b118893cb8e4542be3c02dd61648c61/roles/97d3bcc0648347dca3c54f5645c5227a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:03.831344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097af9aa-87dc-4786-ba35-95520bc1913f None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=2b118893cb8e4542be3c02dd61648c61, role_id=97d3bcc0648347dca3c54f5645c5227a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:03.833384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097af9aa-87dc-4786-ba35-95520bc1913f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:03.850833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 332/660] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:17:03 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/2b118893cb8e4542be3c02dd61648c61/roles/97d3bcc0648347dca3c54f5645c5227a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:17:04.108928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba512-9e1b-4495-9d34-c21123d6efe3 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:04.109914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba512-9e1b-4495-9d34-c21123d6efe3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:04.110401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba512-9e1b-4495-9d34-c21123d6efe3 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:04.112259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 329/661] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:04.118608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde345e6-63db-4e12-baf0-8a9bc9b3154c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:04.119060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde345e6-63db-4e12-baf0-8a9bc9b3154c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:04.119148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde345e6-63db-4e12-baf0-8a9bc9b3154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:04.124724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2040-ae4b-47ae-b2d1-cee8f203693e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:04.125252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2040-ae4b-47ae-b2d1-cee8f203693e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:04.125717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2040-ae4b-47ae-b2d1-cee8f203693e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:04.127461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 330/662] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:17:04.132758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896e20-28fc-4b78-869e-8ecb1a7dbf73 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:04.133275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896e20-28fc-4b78-869e-8ecb1a7dbf73 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:04.133744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896e20-28fc-4b78-869e-8ecb1a7dbf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:04.138427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cde345e6-63db-4e12-baf0-8a9bc9b3154c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:04.139616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cde345e6-63db-4e12-baf0-8a9bc9b3154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:04.152629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-74896e20-28fc-4b78-869e-8ecb1a7dbf73 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:04.154172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-74896e20-28fc-4b78-869e-8ecb1a7dbf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:04.219405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 333/663] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:04 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:04.230916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 331/664] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:04 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:04.484237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde345e6-63db-4e12-baf0-8a9bc9b3154c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:04.500397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896e20-28fc-4b78-869e-8ecb1a7dbf73 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:04.568236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:04.616531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896e20-28fc-4b78-869e-8ecb1a7dbf73 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:04.625790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde345e6-63db-4e12-baf0-8a9bc9b3154c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:04.657552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:04.672988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:04.673600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:04.673880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:04.674151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:04.674807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:04.676218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:04.676564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:04.677407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:04.677884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:04.678353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:04.679240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:04.681443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:04.691989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:04.693072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:17:04.693967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:04.698068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 334/665] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 12 12:17:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:04.699496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:04.703258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 332/666] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:04 2022] POST /identity/v3/services => generated 241 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:17:04.816054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d136-78d7-4b63-9611-e2236bfcd21b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:04.860125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:04.860755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:04.861036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:04.861311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:04.861959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:04.862262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:04.863667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:04.873944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 335/667] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:04.875368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:04.989284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c19d-2c0b-43d9-ba29-734358558429 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:05.025935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:05.038098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:05.038646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:05.039294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:05.039780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:05.040737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:05.041431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:05.042877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:05.051933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 333/668] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:05.054408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:05.106994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:05.168277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c8e52-8597-4f27-bff6-765e9e1fe7ff None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:05.204051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682a152-5dca-4426-b669-cf18d645fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:05.204660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a152-5dca-4426-b669-cf18d645fa6d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:05.204941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a152-5dca-4426-b669-cf18d645fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:05.205214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a152-5dca-4426-b669-cf18d645fa6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:05.205921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682a152-5dca-4426-b669-cf18d645fa6d None admin] RBAC: Adding query filter params (interface=public, service_id=562e665d26b4485e8726369d3f75e16c, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:05.206226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682a152-5dca-4426-b669-cf18d645fa6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:05.207656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682a152-5dca-4426-b669-cf18d645fa6d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:05.218229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 336/669] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:17:05 2022] GET /identity/v3/endpoints?service_id=562e665d26b4485e8726369d3f75e16c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:05.219688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:05.241865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f172-c598-4a75-a2b0-403f5b102023 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:05.242151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f172-c598-4a75-a2b0-403f5b102023 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:05.242432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f172-c598-4a75-a2b0-403f5b102023 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:05.244061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 337/670] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:05.249375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3c317-12f5-4440-b73a-6b1e90caf37f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:05.249753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3c317-12f5-4440-b73a-6b1e90caf37f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:05.250102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3c317-12f5-4440-b73a-6b1e90caf37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:05.270008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a4f3c317-12f5-4440-b73a-6b1e90caf37f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:05.271239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a4f3c317-12f5-4440-b73a-6b1e90caf37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:05.335786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca7d3-d205-4d5c-9643-6d5e528a7320 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:05.363292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 338/671] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:05 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:05.382085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c1692-197e-4d14-862e-090d107cd33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:05.382743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c1692-197e-4d14-862e-090d107cd33f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:05.383030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c1692-197e-4d14-862e-090d107cd33f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:05.383302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c1692-197e-4d14-862e-090d107cd33f None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:05.383943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c1692-197e-4d14-862e-090d107cd33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:05.385323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c1692-197e-4d14-862e-090d107cd33f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:05.395955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 334/672] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:17:05 2022] GET /identity/v3/services => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:17:05.642274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3c317-12f5-4440-b73a-6b1e90caf37f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:05.684810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:05.746867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3c317-12f5-4440-b73a-6b1e90caf37f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:05.789206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c125d7-bfb8-429b-b983-087ed0550e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:05.789831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c125d7-bfb8-429b-b983-087ed0550e0c None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:05.790118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c125d7-bfb8-429b-b983-087ed0550e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:05.790395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c125d7-bfb8-429b-b983-087ed0550e0c None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:05.791055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c125d7-bfb8-429b-b983-087ed0550e0c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:05.792478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c125d7-bfb8-429b-b983-087ed0550e0c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:05.809677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 339/673] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:05 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:06.052791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927376e-c89d-4985-a3dc-2f12678091c7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:06.053038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927376e-c89d-4985-a3dc-2f12678091c7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:06.053260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927376e-c89d-4985-a3dc-2f12678091c7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:06.054846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 335/674] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:06.060122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bdced-fd2c-4194-ad40-907de3eb29e8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:06.060412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bdced-fd2c-4194-ad40-907de3eb29e8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:06.060690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bdced-fd2c-4194-ad40-907de3eb29e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:06.079152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bf7bdced-fd2c-4194-ad40-907de3eb29e8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:06.080360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bf7bdced-fd2c-4194-ad40-907de3eb29e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:06.153581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 340/675] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:06.418793 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927376e-c89d-4985-a3dc-2f12678091c7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:06.473316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:06.533633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927376e-c89d-4985-a3dc-2f12678091c7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:06.569135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:06.570116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:06.570600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:06.571088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:06.582632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:06.588279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:06.589208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:06.590058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:06.592709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 336/676] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 12 12:17:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:06.598427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bdced-fd2c-4194-ad40-907de3eb29e8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:06.630324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:06.707309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bdced-fd2c-4194-ad40-907de3eb29e8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:06.747203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:06.748236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:06.748739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:06.749236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:06.750102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:06.750614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:06.752212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:06.762117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 341/677] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 12 12:17:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:06.770587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:06.882021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f215c-d6eb-4deb-b6f9-b32e08501ec6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:06.892540 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:06.916656 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1c39-0048-486c-b6e4-ad3c1114b5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:06.917284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1c39-0048-486c-b6e4-ad3c1114b5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:06.917565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1c39-0048-486c-b6e4-ad3c1114b5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:06.917839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1c39-0048-486c-b6e4-ad3c1114b5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:06.928957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1c39-0048-486c-b6e4-ad3c1114b5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:06.930416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1c39-0048-486c-b6e4-ad3c1114b5a5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2bfe1c39-0048-486c-b6e4-ad3c1114b5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:06.945215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:06.946261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:06.947258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:06.947258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:06.947258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:06.947258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 337/678] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:06.954336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.046838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:07.060326 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc2cc6-bc61-4719-a3ec-7857712ed8e1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:07.080171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09efbf-2bba-4773-8f10-ccc6b5a04418 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.080758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09efbf-2bba-4773-8f10-ccc6b5a04418 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.081252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09efbf-2bba-4773-8f10-ccc6b5a04418 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.083140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 338/679] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:17:07.089080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea02de-4639-455c-834f-fcc5b2f6145a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.089646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea02de-4639-455c-834f-fcc5b2f6145a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.090128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea02de-4639-455c-834f-fcc5b2f6145a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.097386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:07.097993 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.098796 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.099084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.099726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:07.100057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:07.101473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:07.110676 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-dfea02de-4639-455c-834f-fcc5b2f6145a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:07.112298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dfea02de-4639-455c-834f-fcc5b2f6145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:07.118760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 342/680] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:07.119898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.197261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 339/681] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:07.228824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b1f7-2a0a-44eb-88e4-94dfc154e2b3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:07.264950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:07.265572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.265849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.266118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.274174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:07.275643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:17:07.287428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:07.288403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:07.289346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 343/682] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:07.296220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea02de-4639-455c-834f-fcc5b2f6145a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.391509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:07.401129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea02de-4639-455c-834f-fcc5b2f6145a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:07.434637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:07.435282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.435558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.435857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.436641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:07.436950 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:07.438487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:07.456922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 340/683] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:07.463203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.475757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:07.479221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.572860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79960e1-5552-40e3-976c-21c5977f45aa None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:07.590351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b081d-20c1-4a0a-a79b-efe5ed4a37b4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:07.610248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4e8e5-8ff5-4795-af21-56481b8810e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:07.611048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e8e5-8ff5-4795-af21-56481b8810e6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.611330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e8e5-8ff5-4795-af21-56481b8810e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.611602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e8e5-8ff5-4795-af21-56481b8810e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.632449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:07.633571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.634097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.634562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.635342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:07.637075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:07.647067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:07.648090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:07.648978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:07.656172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 341/684] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:07.658024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.676209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:07.684089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4e8e5-8ff5-4795-af21-56481b8810e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:07.685821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4e8e5-8ff5-4795-af21-56481b8810e6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:07.697275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:07.772839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42ada5-0ebb-43e0-a1ce-e9b41704759b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:07.790775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 344/685] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:17:07.792379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b4c59-b4d2-4dc0-aec1-8ea85845a3c4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.792908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b4c59-b4d2-4dc0-aec1-8ea85845a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.793386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b4c59-b4d2-4dc0-aec1-8ea85845a3c4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.794835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 345/686] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:07.796274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b4c59-b4d2-4dc0-aec1-8ea85845a3c4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.817880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3751e7-8057-46d1-80ea-6e2393030c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:07.818493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3751e7-8057-46d1-80ea-6e2393030c6e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.818787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3751e7-8057-46d1-80ea-6e2393030c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.819096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3751e7-8057-46d1-80ea-6e2393030c6e None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.819731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3751e7-8057-46d1-80ea-6e2393030c6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:07.820137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3751e7-8057-46d1-80ea-6e2393030c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:07.821539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3751e7-8057-46d1-80ea-6e2393030c6e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:07.826838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 342/687] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:07.828268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7043-44a8-41ed-aa7b-1e70e4797fbd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.828556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7043-44a8-41ed-aa7b-1e70e4797fbd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.828835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7043-44a8-41ed-aa7b-1e70e4797fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.847773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2b8c7043-44a8-41ed-aa7b-1e70e4797fbd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:07.849923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2b8c7043-44a8-41ed-aa7b-1e70e4797fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:07.911741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b4c59-b4d2-4dc0-aec1-8ea85845a3c4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:07.920766 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:07.932131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 343/688] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:07.933175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7043-44a8-41ed-aa7b-1e70e4797fbd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:07.944074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:07.949695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:07.950348 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:07.950627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:07.950902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:07.962992 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:07.964588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:07.981504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:07.982551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:07.983545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:07.983545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:07.983545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:07.987467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 346/689] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:07.988400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.044337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7043-44a8-41ed-aa7b-1e70e4797fbd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.080019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c56891-600d-478f-bfd9-fcf37cffb703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.080634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c56891-600d-478f-bfd9-fcf37cffb703 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.080917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c56891-600d-478f-bfd9-fcf37cffb703 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.081188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c56891-600d-478f-bfd9-fcf37cffb703 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.081827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c56891-600d-478f-bfd9-fcf37cffb703 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:08.082133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c56891-600d-478f-bfd9-fcf37cffb703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.083522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c56891-600d-478f-bfd9-fcf37cffb703 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.088477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 344/690] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:08.089442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca99ad-f330-4e74-859e-c923c65b9244 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.089731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca99ad-f330-4e74-859e-c923c65b9244 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.090006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca99ad-f330-4e74-859e-c923c65b9244 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.091354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 345/691] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:08.095815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca99ad-f330-4e74-859e-c923c65b9244 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.096107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace7e6-463a-4e2c-a556-6282fe488854 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.132770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0c495-c64e-494a-99f4-4eea0b567fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.133679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0c495-c64e-494a-99f4-4eea0b567fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.134110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0c495-c64e-494a-99f4-4eea0b567fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.134376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0c495-c64e-494a-99f4-4eea0b567fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.135013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0c495-c64e-494a-99f4-4eea0b567fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:08.135306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0c495-c64e-494a-99f4-4eea0b567fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.136694 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0c495-c64e-494a-99f4-4eea0b567fe3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.153512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 347/692] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:08.153512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f681e-c5a4-4680-99e4-100812ed0564 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.153512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f681e-c5a4-4680-99e4-100812ed0564 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.153512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f681e-c5a4-4680-99e4-100812ed0564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.170199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-de8f681e-c5a4-4680-99e4-100812ed0564 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:08.171347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-de8f681e-c5a4-4680-99e4-100812ed0564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:08.176342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:08.187412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:08.207698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca99ad-f330-4e74-859e-c923c65b9244 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.239876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 348/693] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:08.240657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f681e-c5a4-4680-99e4-100812ed0564 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.241789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.242400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.242685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.242960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.243663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] RBAC: Adding query filter params (interface=public, service_id=e046e56cf6194b248c6c1a16ba81d93e, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:08.244002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.245375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.252259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 346/694] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/endpoints?service_id=e046e56cf6194b248c6c1a16ba81d93e&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:08.253288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.351433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f681e-c5a4-4680-99e4-100812ed0564 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.358810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d79b4-8b2b-4103-914b-c0506831aabb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.386606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.387235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.387517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.387809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.394932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.396450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.397199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.397821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.398107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.398384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.398975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.400373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.403281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:17:08.408705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:08.409761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:08.410889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:08.411404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:08.412459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:08.413500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 347/695] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:08.414447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.415675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 349/696] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:08.417333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.433313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:08.523172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c440b-92cc-4f48-a6fa-16f2a90f88e8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.528841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4634-6531-4aa4-9754-0fbb8516db04 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.557087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.557687 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.558036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.558238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.558846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.560244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.561312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.561914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.562199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.562474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.563107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:08.563413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.564801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.566070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 348/697] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:17:08.566847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.572738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 350/698] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:08.572738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.635463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:08.662661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:08.679883 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29379a-bb7b-4921-96e1-7679227fc30f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.691851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d1102-6d3c-4312-8409-ad02c5a81acb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.718643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.719424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.719706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.720351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.721060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:08.721363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.723036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.728471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.729117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.729403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.729778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.730370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.731750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.736895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 349/699] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:08.737236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:08.741745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:08.742747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:08.743679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 351/700] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:08.744518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.846557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f3f1-112c-4949-933e-eb3e6a74aa87 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.867654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b067084-cceb-44f2-85c5-bb939539f62a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:08.874740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:08.887134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.887742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.888052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.888325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.888957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:08.889260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.890617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.895899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 350/701] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:08.896640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.908242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:08.908844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:08.909119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:08.909383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:08.910105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] RBAC: Adding query filter params (role.id=97d3bcc0648347dca3c54f5645c5227a, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=2b118893cb8e4542be3c02dd61648c61) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:08.910406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:08.912402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:08.927826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 352/702] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/role_assignments?user.id=2b118893cb8e4542be3c02dd61648c61&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=97d3bcc0648347dca3c54f5645c5227a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:08.927826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:08.929116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:09.002146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895169c-ab65-4ffe-b1e7-818ff67cc021 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:09.042374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:09.043032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:09.043315 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:09.043590 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:09.044280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:09.044586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:09.045992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:09.052072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 351/703] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:09.058179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:09.059483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d857f9-0884-4833-b013-2231034249ed None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:09.109945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:09.110560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:09.110840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:09.111110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:09.111786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:09.114110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:09.126855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:09.139449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 353/704] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:17:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:09.186360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f6f90-3d4b-424e-9528-d233d20c022a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:09.233707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:09.234340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:09.234629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:09.234890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:09.235552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:09.235893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:09.237460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:09.243678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 352/705] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:09.249757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:09.316947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:09.364338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dce05-619a-4368-9337-bc0fc2c73130 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:09.402249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251ff8d-6c09-4797-91d3-da8e1f730313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:09.403236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ff8d-6c09-4797-91d3-da8e1f730313 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:09.403791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ff8d-6c09-4797-91d3-da8e1f730313 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:09.404301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ff8d-6c09-4797-91d3-da8e1f730313 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:09.405203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251ff8d-6c09-4797-91d3-da8e1f730313 None admin] RBAC: Adding query filter params (interface=public, service_id=3e512a3352c341af99d206a65cdbcb61, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:09.405710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251ff8d-6c09-4797-91d3-da8e1f730313 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:09.407302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251ff8d-6c09-4797-91d3-da8e1f730313 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:09.413474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 354/706] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:17:09 2022] GET /identity/v3/endpoints?service_id=3e512a3352c341af99d206a65cdbcb61&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:09.418860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:09.534248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb8cd8-542d-431b-8bd0-f31701056d89 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:09.549867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:09.573402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c85e-a742-40ac-b0cb-5a08e32da0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:09.574341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c85e-a742-40ac-b0cb-5a08e32da0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:09.574847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c85e-a742-40ac-b0cb-5a08e32da0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:09.575329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c85e-a742-40ac-b0cb-5a08e32da0d6 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:09.576201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c85e-a742-40ac-b0cb-5a08e32da0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:09.578102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c85e-a742-40ac-b0cb-5a08e32da0d6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:09.585473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 353/707] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:17:09 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:17:10.786808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58532c-faf2-4aad-96bd-7fdaea5b9714 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:10.787284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58532c-faf2-4aad-96bd-7fdaea5b9714 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:10.787370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58532c-faf2-4aad-96bd-7fdaea5b9714 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:10.789008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 355/708] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:10.794329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b6319-61e9-40f3-97b1-d29eab8edc1c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:10.794755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b6319-61e9-40f3-97b1-d29eab8edc1c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:10.794929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b6319-61e9-40f3-97b1-d29eab8edc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:10.817822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2c5b6319-61e9-40f3-97b1-d29eab8edc1c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:10.819446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2c5b6319-61e9-40f3-97b1-d29eab8edc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:10.891763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 354/709] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:11.161739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58532c-faf2-4aad-96bd-7fdaea5b9714 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:11.249955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa54a-d907-415e-b5c7-ee6d1bd56271 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.250238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa54a-d907-415e-b5c7-ee6d1bd56271 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.250508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa54a-d907-415e-b5c7-ee6d1bd56271 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.254962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 355/710] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:11.258485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673919-d82f-46bd-8a6f-d75fc1161cb5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.258878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673919-d82f-46bd-8a6f-d75fc1161cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.259258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673919-d82f-46bd-8a6f-d75fc1161cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.276828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58532c-faf2-4aad-96bd-7fdaea5b9714 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:11.279027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-52673919-d82f-46bd-8a6f-d75fc1161cb5 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:11.280558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-52673919-d82f-46bd-8a6f-d75fc1161cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:11.301741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:11.314099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:11.314768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.315051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.315328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.316072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:11.318103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:11.328767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:11.329857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:11.330733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 356/711] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:11.338172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:11.373529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 356/712] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:11.444615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0bf7-7051-4c78-8d92-f47153d006d9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.444615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0bf7-7051-4c78-8d92-f47153d006d9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.444615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0bf7-7051-4c78-8d92-f47153d006d9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.445520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 357/713] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:17:11.451636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ee59-8d8e-4868-837e-5a2f975510ed None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.451963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ee59-8d8e-4868-837e-5a2f975510ed None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.452495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ee59-8d8e-4868-837e-5a2f975510ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.456259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713cca1-ab8a-4f84-92a3-8f413bd7fb68 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:11.475370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5af2ee59-8d8e-4868-837e-5a2f975510ed None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:11.477016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5af2ee59-8d8e-4868-837e-5a2f975510ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:11.498816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:11.499431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.499715 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.500032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.500671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:11.500978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:11.502412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:11.508414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 357/714] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:11.513194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:11.514398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:11.567982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 358/715] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:11.584850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:11.625810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c7be-382e-40fc-a6a0-3f0b1ce13894 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:11.664020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ee59-8d8e-4868-837e-5a2f975510ed None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:11.664348 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:11.664983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.665266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.665541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.666206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:11.666514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:11.667969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:11.674101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 358/716] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:11.680204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:11.787052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ee59-8d8e-4868-837e-5a2f975510ed None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:11.799672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee593-2cf8-44a0-a6cc-58419390a1bd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:11.814935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:11.823913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6aa79-06a8-4d97-88f7-85c0b5ba81c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:11.825140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6aa79-06a8-4d97-88f7-85c0b5ba81c8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.825761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6aa79-06a8-4d97-88f7-85c0b5ba81c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.826184 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6aa79-06a8-4d97-88f7-85c0b5ba81c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.827468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6aa79-06a8-4d97-88f7-85c0b5ba81c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:11.829019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6aa79-06a8-4d97-88f7-85c0b5ba81c8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:11.837971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7f086-e120-4e2b-b733-c3413f204a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:11.838572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7f086-e120-4e2b-b733-c3413f204a5f None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-57a6aa79-06a8-4d97-88f7-85c0b5ba81c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:11.838819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:11.839779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:11.840661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:11.841418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7f086-e120-4e2b-b733-c3413f204a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.841418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7f086-e120-4e2b-b733-c3413f204a5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.841418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7f086-e120-4e2b-b733-c3413f204a5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:11.841598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 359/717] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Oct 12 12:17:11 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:11.841598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177c6f-fd40-46d3-8620-a9dea69ecd03 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.842333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177c6f-fd40-46d3-8620-a9dea69ecd03 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.842333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177c6f-fd40-46d3-8620-a9dea69ecd03 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.843493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 360/718] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:11.845434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7f086-e120-4e2b-b733-c3413f204a5f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:11.845635 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177c6f-fd40-46d3-8620-a9dea69ecd03 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:11.870220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 359/719] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:17:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:11.870220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194e013-8ddc-4fd2-b743-16773b597e04 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:11.870220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194e013-8ddc-4fd2-b743-16773b597e04 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:11.870556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194e013-8ddc-4fd2-b743-16773b597e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:11.889975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9194e013-8ddc-4fd2-b743-16773b597e04 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:11.890684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:11.891223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9194e013-8ddc-4fd2-b743-16773b597e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:11.969905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 360/720] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:11.974201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177c6f-fd40-46d3-8620-a9dea69ecd03 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:11.977499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194e013-8ddc-4fd2-b743-16773b597e04 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.014616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.015307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.015560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.015875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.016660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] RBAC: Adding query filter params (name=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:12.016955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.018356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.028311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 361/721] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:12.029987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.092416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:12.100831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194e013-8ddc-4fd2-b743-16773b597e04 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.142767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:12.145448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.146127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.146455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.146726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.147310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.148705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.153025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76039dc-847f-4160-9c24-edd73d02aa0c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:12.157627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:12.158650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:12.159501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 361/722] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:12.164970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.192964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.193575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.193855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.194124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.194752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] RBAC: Adding query filter params (type=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:12.195050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.196445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.201332 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 362/723] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:12.236261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.291721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93987fa-a9b3-4552-bd1c-bde2e673916c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.333017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.334161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.334660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.335136 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.336019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:12.336633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.338474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.345066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 362/724] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:17:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:12.346630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ead69-845a-4ace-a8f4-1952aa501a52 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.351951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.380225 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:12.385977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.386621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.386901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.387175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.387765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.389330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:12.399665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:12.400715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:12.401826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 363/725] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:12.407905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.436757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:12.483165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d23eb-8237-437c-b100-74976198a92b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.523288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4bd5-d5f5-42dd-b3f3-15ad02b661e1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.527307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.527957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.528250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.528532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.529176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:12.529542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.530932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.537681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 363/726] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:17:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:12.569202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.569842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.570126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.570400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.571053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:12.571354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.572797 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.579258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 364/727] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:12.585631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.687332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:12.707048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48176cc-fc51-4bc3-b0cd-a137c98a9097 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.749265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa1b7-c2c0-4858-8566-33c1d4e417f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.749870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa1b7-c2c0-4858-8566-33c1d4e417f6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.750151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa1b7-c2c0-4858-8566-33c1d4e417f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.750495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa1b7-c2c0-4858-8566-33c1d4e417f6 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.751127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fa1b7-c2c0-4858-8566-33c1d4e417f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:12.751423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fa1b7-c2c0-4858-8566-33c1d4e417f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.752887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fa1b7-c2c0-4858-8566-33c1d4e417f6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.759051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 364/728] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Oct 12 12:17:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:12.764785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:12.864743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:12.870915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79224c-8e1f-45be-b5c9-c13d45489f4d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:12.908675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14f798-905c-4575-add0-8850adf9865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:12.909289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14f798-905c-4575-add0-8850adf9865f None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:12.909574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14f798-905c-4575-add0-8850adf9865f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:12.909850 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14f798-905c-4575-add0-8850adf9865f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:12.910593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14f798-905c-4575-add0-8850adf9865f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:12.912002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14f798-905c-4575-add0-8850adf9865f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:12.936345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 365/729] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:17:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:14.180097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4cc7-506c-468f-b106-5c02f9dba3c5 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.181123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4cc7-506c-468f-b106-5c02f9dba3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.181610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4cc7-506c-468f-b106-5c02f9dba3c5 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.183402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 365/730] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:14.189196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ffdfe-400e-4fa5-882a-be3cf3c6421b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.190026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ffdfe-400e-4fa5-882a-be3cf3c6421b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.190507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ffdfe-400e-4fa5-882a-be3cf3c6421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.209748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2d5ffdfe-400e-4fa5-882a-be3cf3c6421b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:14.211249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2d5ffdfe-400e-4fa5-882a-be3cf3c6421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:14.287393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 366/731] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:14.453325 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490767c-fd23-4607-8f0f-1bfdd776b201 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.453951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490767c-fd23-4607-8f0f-1bfdd776b201 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.454447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490767c-fd23-4607-8f0f-1bfdd776b201 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.456290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 366/732] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:14.462069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676804-5c50-4d1a-9fa1-c72978b951ea None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.462354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676804-5c50-4d1a-9fa1-c72978b951ea None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.462628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676804-5c50-4d1a-9fa1-c72978b951ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.481305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-99676804-5c50-4d1a-9fa1-c72978b951ea None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:14.482413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-99676804-5c50-4d1a-9fa1-c72978b951ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:14.543074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:14.552340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 367/733] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:14.573303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490767c-fd23-4607-8f0f-1bfdd776b201 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:14.685054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490767c-fd23-4607-8f0f-1bfdd776b201 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:14.721175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:14.722162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.722667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.723672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.724530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:14.726144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:14.736523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:14.737526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:14.738384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:14.741818 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 367/734] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:14.746205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750582-376c-4277-9369-99486b0892e4 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.746205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750582-376c-4277-9369-99486b0892e4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.746205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750582-376c-4277-9369-99486b0892e4 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.746205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 368/735] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:14.748293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:14.749552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d81da-fabf-403a-8f6b-4ea93bb618fc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.749843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d81da-fabf-403a-8f6b-4ea93bb618fc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.750186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d81da-fabf-403a-8f6b-4ea93bb618fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.768548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:14.772028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5d4d81da-fabf-403a-8f6b-4ea93bb618fc None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:14.774394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5d4d81da-fabf-403a-8f6b-4ea93bb618fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:14.850167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 369/736] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:14.851379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d81da-fabf-403a-8f6b-4ea93bb618fc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:14.858931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e820e4-bd07-46d0-b673-1f256ff19ebd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:14.897413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:14.898697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:14.899518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:14.900029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:14.901032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:14.901538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:14.903683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:14.911097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 368/737] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:14.919123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:14.970940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d81da-fabf-403a-8f6b-4ea93bb618fc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:15.004444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:15.012575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:15.017834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:15.018718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.019145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.019564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.021438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:15.023220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:15.033915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0013-fdaf-4de8-9733-bca5c928c16b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:15.050652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 370/738] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:14 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:15.087651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:15.088380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.088662 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.088949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.089602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:15.089904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:15.091570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:15.099648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 369/739] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:15.105981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:15.161346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:15.225324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53362-f536-410c-8443-b10be2854ae6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:15.262478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3e834-2262-45f6-8bb8-9ab53dda7eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:15.263603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3e834-2262-45f6-8bb8-9ab53dda7eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.263603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3e834-2262-45f6-8bb8-9ab53dda7eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.263603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3e834-2262-45f6-8bb8-9ab53dda7eb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.264309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3e834-2262-45f6-8bb8-9ab53dda7eb0 None admin] RBAC: Adding query filter params (interface=admin, service_id=e046e56cf6194b248c6c1a16ba81d93e, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:15.264618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3e834-2262-45f6-8bb8-9ab53dda7eb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:15.265970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3e834-2262-45f6-8bb8-9ab53dda7eb0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:15.272437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 371/740] 10.222.0.45 () {56 vars in 1249 bytes} [Wed Oct 12 12:17:15 2022] GET /identity/v3/endpoints?service_id=e046e56cf6194b248c6c1a16ba81d93e&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:15.274717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e017e-3d8b-4cba-9274-5be2f5bc21f8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.275306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e017e-3d8b-4cba-9274-5be2f5bc21f8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.275582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e017e-3d8b-4cba-9274-5be2f5bc21f8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.277285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 372/741] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:15.277997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e017e-3d8b-4cba-9274-5be2f5bc21f8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:15.283676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db4810-cce4-457c-a85c-52110617ccf8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:15.319160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f437-f983-44ee-bba7-f923739e8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:15.319854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f437-f983-44ee-bba7-f923739e8ad6 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.320141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f437-f983-44ee-bba7-f923739e8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.320411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f437-f983-44ee-bba7-f923739e8ad6 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.321074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f437-f983-44ee-bba7-f923739e8ad6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:15.322450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f437-f983-44ee-bba7-f923739e8ad6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:15.334861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:15.338626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:15.348635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 370/742] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:15 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:17:15.351181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319d72-2dc9-4529-9a29-5b050571ae5f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.353082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319d72-2dc9-4529-9a29-5b050571ae5f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.353550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319d72-2dc9-4529-9a29-5b050571ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.378316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e6319d72-2dc9-4529-9a29-5b050571ae5f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:15.380481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e6319d72-2dc9-4529-9a29-5b050571ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:15.419960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e017e-3d8b-4cba-9274-5be2f5bc21f8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:15.463441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:15.464098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.464381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.464650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.465266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:15.466288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 371/743] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:15 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:15.469107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:15.482594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 373/744] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:17:15 2022] GET /identity/v3/services => generated 1957 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:17:15.741930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319d72-2dc9-4529-9a29-5b050571ae5f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:15.858395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319d72-2dc9-4529-9a29-5b050571ae5f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:15.892729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:15.899353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:15.900003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:15.900291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:15.900561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:15.901215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:15.902638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:15.905449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING keystone.server.flask.common [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 12:17:15.923939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 12:17:15.923939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:17:15.923939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [parameters: {'id': '6b63802ce058446883d8d7d75f74048e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 12:17:15.923939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b63802ce058446883d8d7d75f74048e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b63802ce058446883d8d7d75f74048e. Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:17:15.932159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 12:17:15.932959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 12 12:17:15.934321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:17:15.935218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:17:15.936727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:17:15.938545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'id': '6b63802ce058446883d8d7d75f74048e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:15.940632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:15.943169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b63802ce058446883d8d7d75f74048e. Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:15.946259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 372/745] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Oct 12 12:17:15 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:15.953364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:16.066469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f706dbf-6709-4390-92c0-c99a0fd031a5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:16.081585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:16.104416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e1986-64a2-43e3-a594-655aad65b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:16.105446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e1986-64a2-43e3-a594-655aad65b67d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:16.105922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e1986-64a2-43e3-a594-655aad65b67d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:16.106436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e1986-64a2-43e3-a594-655aad65b67d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:16.114136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e1986-64a2-43e3-a594-655aad65b67d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:16.115780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e1986-64a2-43e3-a594-655aad65b67d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-510e1986-64a2-43e3-a594-655aad65b67d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:17:16.127170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:16.128071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:16.128962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:16.135783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 374/746] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:16.137573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:16.243632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa128d-b275-4e06-9bd4-f8d94e1d5327 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:16.281342 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8007f-6363-45e7-8d69-77f3b1a9ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:16.281954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8007f-6363-45e7-8d69-77f3b1a9ac7e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:16.282234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8007f-6363-45e7-8d69-77f3b1a9ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:16.282505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8007f-6363-45e7-8d69-77f3b1a9ac7e None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:16.283177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8007f-6363-45e7-8d69-77f3b1a9ac7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:16.283472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8007f-6363-45e7-8d69-77f3b1a9ac7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:16.285142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8007f-6363-45e7-8d69-77f3b1a9ac7e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:16.307102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 373/747] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:17:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:17.252770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e052-f633-4338-8279-1cdd7d00496f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.253312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e052-f633-4338-8279-1cdd7d00496f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.253604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e052-f633-4338-8279-1cdd7d00496f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.256047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 375/748] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:17.261768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e044-74ec-49d6-858d-f2d8ae53f060 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.262190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e044-74ec-49d6-858d-f2d8ae53f060 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.262562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e044-74ec-49d6-858d-f2d8ae53f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.281922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4fc2e044-74ec-49d6-858d-f2d8ae53f060 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:17.283432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4fc2e044-74ec-49d6-858d-f2d8ae53f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:17.327970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:17.353809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 374/749] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:17.534018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a7feb-098e-412a-a2e7-4725edb3aa29 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.534204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a7feb-098e-412a-a2e7-4725edb3aa29 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.534485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a7feb-098e-412a-a2e7-4725edb3aa29 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.536105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 376/750] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:17.545196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b594-c209-4b95-b959-7f69b71f6c9d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.545588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b594-c209-4b95-b959-7f69b71f6c9d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.545970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b594-c209-4b95-b959-7f69b71f6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.565040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8fc7b594-c209-4b95-b959-7f69b71f6c9d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:17.566363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8fc7b594-c209-4b95-b959-7f69b71f6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:17.632325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a7feb-098e-412a-a2e7-4725edb3aa29 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:17.640467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 375/751] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:17.745070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934d27-dfe6-44b5-9640-0d4267b496ce None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.745259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a7feb-098e-412a-a2e7-4725edb3aa29 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:17.745341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934d27-dfe6-44b5-9640-0d4267b496ce None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.745615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934d27-dfe6-44b5-9640-0d4267b496ce None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.747191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 376/752] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:17.753013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1843a0-5701-43d5-8549-a2fc57235bf4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.753516 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1843a0-5701-43d5-8549-a2fc57235bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.754021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1843a0-5701-43d5-8549-a2fc57235bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.779199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ee1843a0-5701-43d5-8549-a2fc57235bf4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:17.781106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ee1843a0-5701-43d5-8549-a2fc57235bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:17.797624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:17.798292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.798572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.798942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] PATH_INFO: `/v3/services/image` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.799523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:17.801526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:17.811132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:17.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:17.813018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 377/753] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Oct 12 12:17:17 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:17.820393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:17.863219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:17.888165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 377/754] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:17.917734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1843a0-5701-43d5-8549-a2fc57235bf4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:17.936891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e901-2d02-40c3-a89d-539229932797 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:17.952540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:17.979206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:17.980119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:17.980553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:17.980969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:17.981812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] RBAC: Adding query filter params (name=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:17.982257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:17.983963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:17.990541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 378/755] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:17.996036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.020728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1843a0-5701-43d5-8549-a2fc57235bf4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.057316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.058305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.058788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.059259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.060079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.061649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:18.071322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:18.072363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:18.073249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:18.080031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 378/756] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:18.082328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.105276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:18.108803 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10543602-75c3-4ae6-b70e-aaad17b1f299 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.150577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.151518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.151830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.152109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.152756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] RBAC: Adding query filter params (type=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:18.153058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.154441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.160208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 379/757] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:18.166181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.271154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d6601-77d0-4cb6-88f7-a997366a472d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.303977 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:18.305290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.305930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.306205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.306477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.307057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.308270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef2a18-2e1c-44fd-bab9-44751dd00a54 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.308439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:18.317913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:18.318926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:18.319783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 380/758] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:18.320638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.350657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.351274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.351563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.351780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.352566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:18.352719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.353193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:18.354449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.363903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 379/759] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:18.363903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.434895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca67983-bee5-4404-85f6-39bfe297f2f8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.477918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.478290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07f71e-eaa1-4d24-980f-3b3698359de5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.478552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.478837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.479115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.479966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] RBAC: Adding query filter params (interface=public, service_id=a151d1c635a448e8b83ca76c339e44af, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:18.480284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.481722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.487683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 381/760] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/endpoints?service_id=a151d1c635a448e8b83ca76c339e44af&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:18.492151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.518322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.518925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.519206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.519479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.520162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:18.520467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.521830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.526925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 380/761] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:18.527704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.558911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:18.593904 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:18.606077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467501b-fa7d-4dbf-865c-1023d8a8dbff None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.633387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a64f25-a528-45a4-8c1c-fea7fd1ffd0f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.640530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.641130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.641410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.641679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.642304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:18.642603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.643999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.648639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 382/762] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:18.649399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.667379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f9138-0333-429b-8b68-24fe8a1cd9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.667999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9138-0333-429b-8b68-24fe8a1cd9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.668279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9138-0333-429b-8b68-24fe8a1cd9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.668543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9138-0333-429b-8b68-24fe8a1cd9c5 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.669144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f9138-0333-429b-8b68-24fe8a1cd9c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.670497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f9138-0333-429b-8b68-24fe8a1cd9c5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.677477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 381/763] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:17:18.678591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb802-142d-4ce9-9dba-6cd82b327660 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.678872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb802-142d-4ce9-9dba-6cd82b327660 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.679145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb802-142d-4ce9-9dba-6cd82b327660 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.680610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 382/764] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:18.681364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cb802-142d-4ce9-9dba-6cd82b327660 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.768360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2019ba-6e2d-406b-912e-3196b6e83081 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.792831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:18.804476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cb802-142d-4ce9-9dba-6cd82b327660 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:18.807915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d09f5b-41bd-43a1-bb73-dd67facdbf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.808547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09f5b-41bd-43a1-bb73-dd67facdbf10 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.808826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09f5b-41bd-43a1-bb73-dd67facdbf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.809149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09f5b-41bd-43a1-bb73-dd67facdbf10 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.809741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d09f5b-41bd-43a1-bb73-dd67facdbf10 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:18.810043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d09f5b-41bd-43a1-bb73-dd67facdbf10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.811423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d09f5b-41bd-43a1-bb73-dd67facdbf10 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.817000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 383/765] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:18.818285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a989-1bfd-4b1d-8af3-cdfad8bed9f1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.818571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a989-1bfd-4b1d-8af3-cdfad8bed9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.818844 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a989-1bfd-4b1d-8af3-cdfad8bed9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.838893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-67a9a989-1bfd-4b1d-8af3-cdfad8bed9f1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:18.840153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-67a9a989-1bfd-4b1d-8af3-cdfad8bed9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:18.849065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:18.849680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:18.849957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:18.850224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:18.851204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] RBAC: Adding query filter params (interface=public, service_id=0c7e825e1c5e468d943478e2dc9ca6d3, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:18.851312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:18.852627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:18.855619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:18.859490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 383/766] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/endpoints?service_id=0c7e825e1c5e468d943478e2dc9ca6d3&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:18.860427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.918382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 384/767] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:18 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:18.919227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a989-1bfd-4b1d-8af3-cdfad8bed9f1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:18.979402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321910-01ec-4679-9e8b-8315b955fc4e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:19.014726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:19.015332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:19.015641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:19.016217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:19.016653 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:19.018143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:19.039944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 384/768] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:17:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:19.050603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a989-1bfd-4b1d-8af3-cdfad8bed9f1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:19.097012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:19.098536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:19.099033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:19.099522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:19.100379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:19.101994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:19.109946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 385/769] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:17:18 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:17:19.193788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:19.215923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:19.309895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9a9dc-3b25-4328-b204-e86f8b28abbc None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:19.345740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:19.346351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:19.346634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:19.346907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:19.347627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:19.349040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:19.364777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 12:17:19.364777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 12:17:19.364777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [parameters: {'user_id': '08c82d8a433e40da8af8960128efde0a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 12:17:19.364777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:17:19.371891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:17:19.372753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:17:19.373764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:17:19.374663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:17:19.375570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:17:19.376520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'user_id': '08c82d8a433e40da8af8960128efde0a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:19.377350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 12 12:17:19.378146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 12 12:17:19.382173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 12 12:17:19.382173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 12 12:17:19.382173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:17:19.382173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:17:19.382173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 12:17:19.382173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:19.382173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 385/770] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Oct 12 12:17:19 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:19.382963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:19.397909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:19.495894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483e389-f2f4-45e5-87f1-4f8f0e689674 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:19.532585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ade286-e97b-4ea4-b69d-f3e822dc76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:19.533222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade286-e97b-4ea4-b69d-f3e822dc76da None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:19.533508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade286-e97b-4ea4-b69d-f3e822dc76da None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:19.533786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade286-e97b-4ea4-b69d-f3e822dc76da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:19.541277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ade286-e97b-4ea4-b69d-f3e822dc76da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:19.542716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ade286-e97b-4ea4-b69d-f3e822dc76da None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-54ade286-e97b-4ea4-b69d-f3e822dc76da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:17:19.555355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:19.557554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:17:19.559924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:19.563491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 386/771] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:17:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:19.563680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:19.652110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:19.674849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44270-a590-4c1b-ae4b-849cd34f51b3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:19.712107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3abd0-4a37-4d7f-9377-b014add9dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:19.712718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3abd0-4a37-4d7f-9377-b014add9dc5b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:19.713000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3abd0-4a37-4d7f-9377-b014add9dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:19.713264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3abd0-4a37-4d7f-9377-b014add9dc5b None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:19.713961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3abd0-4a37-4d7f-9377-b014add9dc5b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:19.714261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3abd0-4a37-4d7f-9377-b014add9dc5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:19.715911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3abd0-4a37-4d7f-9377-b014add9dc5b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:19.755081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 386/772] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Oct 12 12:17:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:20.855988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481e8e6-b4a4-424e-9141-d0765c5de471 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:20.856502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481e8e6-b4a4-424e-9141-d0765c5de471 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:20.856502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481e8e6-b4a4-424e-9141-d0765c5de471 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:20.857892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 387/773] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:20.863137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda870f-2664-459e-b164-390d595b3d73 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:20.863547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda870f-2664-459e-b164-390d595b3d73 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:20.863724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda870f-2664-459e-b164-390d595b3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:20.882759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2dda870f-2664-459e-b164-390d595b3d73 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:20.884307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2dda870f-2664-459e-b164-390d595b3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:20.951856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 387/774] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:21.220426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481e8e6-b4a4-424e-9141-d0765c5de471 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:21.295635 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:21.310999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1bee-70e9-400c-b43a-83002d009052 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.311533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1bee-70e9-400c-b43a-83002d009052 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.311839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1bee-70e9-400c-b43a-83002d009052 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.313741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 388/775] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:17:21.319404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46629f-badf-4692-90fa-3ce14364d39f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.319692 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46629f-badf-4692-90fa-3ce14364d39f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.319999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46629f-badf-4692-90fa-3ce14364d39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.332535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481e8e6-b4a4-424e-9141-d0765c5de471 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:21.338332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9f46629f-badf-4692-90fa-3ce14364d39f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:21.339832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9f46629f-badf-4692-90fa-3ce14364d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:21.370021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:21.370889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.371356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.371629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] PATH_INFO: `/v3/services/image` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.372255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:21.373613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:21.382436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:21.383456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:21.384364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 388/776] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Oct 12 12:17:21 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:21.389236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:21.409517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:21.417991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 389/777] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:21.419210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabb94a-2834-44b8-81c5-13dd3145287d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.419494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabb94a-2834-44b8-81c5-13dd3145287d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.419767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabb94a-2834-44b8-81c5-13dd3145287d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.424944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 390/778] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:21.427148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065cf17-1fe8-45a1-8005-b5dad75a6b3b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.427431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065cf17-1fe8-45a1-8005-b5dad75a6b3b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.427702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065cf17-1fe8-45a1-8005-b5dad75a6b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.446101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a065cf17-1fe8-45a1-8005-b5dad75a6b3b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:21.447261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a065cf17-1fe8-45a1-8005-b5dad75a6b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:21.494384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3d7ad-d04a-4558-ad03-883f06f3badc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:21.520109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 391/779] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:21.530683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:21.531288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.531569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.531867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.532499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] RBAC: Adding query filter params (name=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:21.532801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:21.534160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:21.535306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:21.543310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 389/780] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:21.546618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065cf17-1fe8-45a1-8005-b5dad75a6b3b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:21.647532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065cf17-1fe8-45a1-8005-b5dad75a6b3b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:21.673259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:21.682999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:21.683609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.683920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.684198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.684832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] RBAC: Adding query filter params (type=image) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:21.685139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:21.686544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:21.691679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 392/781] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:21.694159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:21.697192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:21.798141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cb28-4dcd-4694-870d-26ef4f08ef7d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:21.804807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69cb0-7b5a-43bb-8352-d316c39f746e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:21.832878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:21.833505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.833787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.834068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.835160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:21.836619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:21.838171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 390/782] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:21.838608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:21.838927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:21.839252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.839491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.839766 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.840465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:21.841826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:21.862926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 393/783] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:17:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:17:21.864174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:21.912177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:21.935404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:21.954730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0257-77d9-47ac-8d23-82956b2f162a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:21.997700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:21.998198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13c147-6a95-4d54-9f37-2eafaff5d2b5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:21.998312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:21.998594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:21.998859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:21.999437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:22.000833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:22.010072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:22.011234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:22.012159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 391/784] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:22.017312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:22.042570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:22.043105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:22.044350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:22.044350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:22.044350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:22.045783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:22.075504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 394/785] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:21 2022] POST /identity/v3/projects => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:22.131573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27832-28c1-494f-acb7-a3da914ff076 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:22.160698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:22.170798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:22.171427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:22.171706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:22.172013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:22.172660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:22.172963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:22.174345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:22.180137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 392/786] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:17:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:22.185688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:22.291984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:22.297239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d3b9-2958-4278-8014-f957b82cc708 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:22.333360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86765a-d469-405a-a261-6691f14ee3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:22.333963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86765a-d469-405a-a261-6691f14ee3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:22.334240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86765a-d469-405a-a261-6691f14ee3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:22.334508 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86765a-d469-405a-a261-6691f14ee3c5 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:22.335130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86765a-d469-405a-a261-6691f14ee3c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:22.335428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86765a-d469-405a-a261-6691f14ee3c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:22.336815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86765a-d469-405a-a261-6691f14ee3c5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:22.341763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 395/787] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Oct 12 12:17:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:22.347214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:22.447166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e406ff-2230-48ef-9cb4-954a3234a032 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:22.482168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780331d9-9666-487d-bccf-c8bc20396159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:22.482773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780331d9-9666-487d-bccf-c8bc20396159 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:22.483052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780331d9-9666-487d-bccf-c8bc20396159 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:22.483324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780331d9-9666-487d-bccf-c8bc20396159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:22.484011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780331d9-9666-487d-bccf-c8bc20396159 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:22.485381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780331d9-9666-487d-bccf-c8bc20396159 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:22.505561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 393/788] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:17:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:24.055163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788207-31da-40e7-8d39-f3182de49c24 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.055700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788207-31da-40e7-8d39-f3182de49c24 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.056035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788207-31da-40e7-8d39-f3182de49c24 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.058265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 396/789] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:17:24.063710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf4e7-9924-4e4f-8bf5-29d3aec2363b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.064144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf4e7-9924-4e4f-8bf5-29d3aec2363b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.064311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf4e7-9924-4e4f-8bf5-29d3aec2363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.084044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-313bf4e7-9924-4e4f-8bf5-29d3aec2363b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:24.085212 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-313bf4e7-9924-4e4f-8bf5-29d3aec2363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:24.139536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:24.184196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 394/790] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:24.315986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f6f2-a5a1-47a1-867f-aacf32000b49 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.316910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f6f2-a5a1-47a1-867f-aacf32000b49 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.317131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f6f2-a5a1-47a1-867f-aacf32000b49 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.318629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 397/791] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:24.323663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778c6a-987b-40fd-81fb-e024363d6e1b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.323987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778c6a-987b-40fd-81fb-e024363d6e1b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.324263 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778c6a-987b-40fd-81fb-e024363d6e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.342559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7f778c6a-987b-40fd-81fb-e024363d6e1b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:24.343737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7f778c6a-987b-40fd-81fb-e024363d6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:24.411019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 395/792] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:24.456012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f6f2-a5a1-47a1-867f-aacf32000b49 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:24.555892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f6f2-a5a1-47a1-867f-aacf32000b49 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:24.590419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:24.590940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.591215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.591480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.592167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:24.593575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:24.602672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:17:24.602672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:17:24.602672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [parameters: {'id': '340b6a2cf2ac4065ba2de504e75e55a4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:17:24.602672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:17:24.610799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 12:17:24.611633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:17:24.612623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:17:24.614008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:17:24.614883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:17:24.615667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'id': '340b6a2cf2ac4065ba2de504e75e55a4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 12:17:24.619989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:24.621894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:24.623944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 398/793] 10.222.0.45 () {60 vars in 1137 bytes} [Wed Oct 12 12:17:24 2022] POST /identity/v3/domains => generated 190 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:24.626993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f778c6a-987b-40fd-81fb-e024363d6e1b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:24.682323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:24.711489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:24.731901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f778c6a-987b-40fd-81fb-e024363d6e1b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:24.733413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:24.770298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37a6b0-c78a-458c-b241-4828fc55adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:24.770933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37a6b0-c78a-458c-b241-4828fc55adbb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.771214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37a6b0-c78a-458c-b241-4828fc55adbb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.771487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37a6b0-c78a-458c-b241-4828fc55adbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.781860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37a6b0-c78a-458c-b241-4828fc55adbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:24.783625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37a6b0-c78a-458c-b241-4828fc55adbb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:24.790692 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971d38-2afc-4a70-9a69-6d85498d144c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1a37a6b0-c78a-458c-b241-4828fc55adbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:24.797792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:24.798939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:24.799886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:24.799886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:24.799886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:24.799886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 396/794] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:24.801035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b66ac9-7c06-4e82-8ee0-e0f1b7bfb8f6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.801293 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b66ac9-7c06-4e82-8ee0-e0f1b7bfb8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.801564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b66ac9-7c06-4e82-8ee0-e0f1b7bfb8f6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.802902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 397/795] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:24.805427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b66ac9-7c06-4e82-8ee0-e0f1b7bfb8f6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:24.829476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af106417-aff8-4d2b-a885-c84db87e93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:24.830102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106417-aff8-4d2b-a885-c84db87e93a6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.830383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106417-aff8-4d2b-a885-c84db87e93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.830658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106417-aff8-4d2b-a885-c84db87e93a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.831781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106417-aff8-4d2b-a885-c84db87e93a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:24.833304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106417-aff8-4d2b-a885-c84db87e93a6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:24.834857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 399/796] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:24.837026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45efb-3f60-4d20-920c-5feb328ea3b5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.837375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45efb-3f60-4d20-920c-5feb328ea3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.837653 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45efb-3f60-4d20-920c-5feb328ea3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.854605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f2e45efb-3f60-4d20-920c-5feb328ea3b5 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:24.855711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f2e45efb-3f60-4d20-920c-5feb328ea3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:24.906926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b66ac9-7c06-4e82-8ee0-e0f1b7bfb8f6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:24.920714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 400/797] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:24.921579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e45efb-3f60-4d20-920c-5feb328ea3b5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:24.944770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:24.945377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:24.945601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:24.945730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:24.945908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:24.946547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:24.946843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:24.954012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:24.975826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 398/798] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:25.040498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e45efb-3f60-4d20-920c-5feb328ea3b5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:25.077404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:25.078081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:25.078309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:25.078548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:25.079204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:25.080672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:25.111929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 401/799] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:17:24 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:25.192695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:25.212113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:25.307915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f5a78-bc02-493c-bead-a7878384063d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:25.340984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:25.341617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:25.341900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:25.342174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:25.353738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:25.358513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:25.359614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:25.360570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 399/800] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 12 12:17:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:25.366204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:25.445312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:25.466505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0d94f-b0d9-427d-9319-ebfab0b145b6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:25.500116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:25.500725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:25.501009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:25.501284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:25.501947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:25.502251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:25.503642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:25.512044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 402/801] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 12 12:17:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:25.517692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:25.591517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:25.617680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e405-750a-486e-8e40-928cbe61f3aa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:25.650621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:25.651246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:25.651525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:25.651813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:25.662570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:25.664048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:25.677623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:25.678572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:25.679489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:25.679489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:25.679489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:25.679489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 400/802] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:25.684439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:25.783216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff37bc7-09c6-4f1e-8640-a753de3e00b9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:25.817171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:25.817771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:25.818050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:25.818320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:25.818957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:25.819257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:25.820649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:25.832527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 403/803] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:25.838108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:25.935102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174cfe8-e0f7-4fc0-8cf8-14aee51c980e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:25.960348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:25.969111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:25.969734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:25.970013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:25.970282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:25.977587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:25.979016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:17:25.989931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:25.991134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:17:25.992264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:25.996735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:25.996938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 401/804] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 12 12:17:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:25.999922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:26.098645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9da46-e665-4d21-a3fa-bdaecd7142eb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:26.131139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:26.131732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:26.132036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:26.132309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:26.133033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:26.133349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:26.134764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:26.151732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 404/805] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 12 12:17:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:26.157476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:26.252782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9da6-c3d8-4916-b7c4-78b5d8c52881 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:26.284900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:26.285515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:26.285795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:26.286066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:26.296143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:26.297579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:26.311678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:26.312796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:26.313725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:26.313725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:26.313725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:26.313725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 402/806] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:26.319261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:26.376333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:26.415847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c2682-090a-4b5f-9c70-92bd4d106fd9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:26.449652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:26.450244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:26.450523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:26.450800 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:26.451431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:26.451732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:26.453376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:26.464263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 405/807] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:26.469665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:26.509449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:26.567454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10516-6644-4c5b-b286-d5b3b4c05cfa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:26.600044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:26.600659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:26.600942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:26.601216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:26.607695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:26.609168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:17:26.621430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:26.622482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:26.623411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 403/808] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:26.628362 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:26.726335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4254c23-c294-4756-bdf6-73c1087c4b5d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:26.745447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:26.759733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7ad0a-d4a9-4f84-8ac2-17303df1b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:26.760295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7ad0a-d4a9-4f84-8ac2-17303df1b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:26.760630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7ad0a-d4a9-4f84-8ac2-17303df1b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:26.760905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7ad0a-d4a9-4f84-8ac2-17303df1b6b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:26.761594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7ad0a-d4a9-4f84-8ac2-17303df1b6b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:26.761894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7ad0a-d4a9-4f84-8ac2-17303df1b6b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:26.763306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7ad0a-d4a9-4f84-8ac2-17303df1b6b9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:26.776582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 406/809] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:26.782407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:26.878915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:26.883225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0ac0-a953-4100-8b5b-8e5b395b75d7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:26.916262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565ec63-21a5-4b30-b706-2a2c98764fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:26.916910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ec63-21a5-4b30-b706-2a2c98764fed None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:26.917187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ec63-21a5-4b30-b706-2a2c98764fed None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:26.917458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ec63-21a5-4b30-b706-2a2c98764fed None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/c01495a37066445293bdb957ece67e20/roles/97d3bcc0648347dca3c54f5645c5227a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:26.919546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565ec63-21a5-4b30-b706-2a2c98764fed None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=c01495a37066445293bdb957ece67e20, role_id=97d3bcc0648347dca3c54f5645c5227a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:26.921009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565ec63-21a5-4b30-b706-2a2c98764fed None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:26.933797 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 404/810] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:17:26 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/c01495a37066445293bdb957ece67e20/roles/97d3bcc0648347dca3c54f5645c5227a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:17:27.280976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70965535-7081-4332-bb8a-048e65486f94 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:27.281532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70965535-7081-4332-bb8a-048e65486f94 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:27.281532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70965535-7081-4332-bb8a-048e65486f94 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:27.282849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 407/811] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:27.288809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291a6b-5a50-485f-9100-9ef6396e0dd9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:27.289213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291a6b-5a50-485f-9100-9ef6396e0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:27.289477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291a6b-5a50-485f-9100-9ef6396e0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:27.307245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d2291a6b-5a50-485f-9100-9ef6396e0dd9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:27.308451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2291a6b-5a50-485f-9100-9ef6396e0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:27.374724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 405/812] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:27.640389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70965535-7081-4332-bb8a-048e65486f94 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:27.738548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70965535-7081-4332-bb8a-048e65486f94 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:27.775770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:27.776434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:27.776714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:27.776987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:27.789073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:27.794007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:27.795084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:27.796052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 408/813] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:27.801292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291a6b-5a50-485f-9100-9ef6396e0dd9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:27.883671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:27.896847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291a6b-5a50-485f-9100-9ef6396e0dd9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:27.929005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:27.929604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:27.929884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:27.930154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:27.930815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:27.931115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:27.932512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:27.940190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 406/814] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:27.945964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:27.987627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:28.044254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f90eeb-cf14-4c76-bfb0-4f4247388413 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:28.076541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:28.077446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:28.077728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:28.077998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] PATH_INFO: `/v3/users/552351d3fb54423ca61cfde06ecec019` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:28.091256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] RBAC: Authorizing `identity:get_user(user_id=552351d3fb54423ca61cfde06ecec019)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:28.092706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:28.094437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 409/815] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:27 2022] GET /identity/v3/users/552351d3fb54423ca61cfde06ecec019 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:28.100802 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:28.197348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262b459-f259-4e78-a202-d84c9b292f41 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:28.229644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296f47d-da22-4306-b90b-942d052a3aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:28.230266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f47d-da22-4306-b90b-942d052a3aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:28.230545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f47d-da22-4306-b90b-942d052a3aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:28.230816 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f47d-da22-4306-b90b-942d052a3aa9 None admin] PATH_INFO: `/v3/projects/24a85598df4d4efb826ab48a27166ae5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:28.231972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f47d-da22-4306-b90b-942d052a3aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=24a85598df4d4efb826ab48a27166ae5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:28.233387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f47d-da22-4306-b90b-942d052a3aa9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:28.235002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 407/816] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:17:28 2022] GET /identity/v3/projects/24a85598df4d4efb826ab48a27166ae5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:28.240951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:28.334173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:28.338473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be272b5-bbff-4ffd-9c6b-d2076f3b3cfe None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:28.370629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2d20-dbbc-4573-a3c4-aa7078573f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:28.371266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2d20-dbbc-4573-a3c4-aa7078573f1b None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:28.371546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2d20-dbbc-4573-a3c4-aa7078573f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:28.371842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2d20-dbbc-4573-a3c4-aa7078573f1b None admin] PATH_INFO: `/v3/projects/24a85598df4d4efb826ab48a27166ae5/users/552351d3fb54423ca61cfde06ecec019/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:28.373721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2d20-dbbc-4573-a3c4-aa7078573f1b None admin] RBAC: Authorizing `identity:create_grant(project_id=24a85598df4d4efb826ab48a27166ae5, user_id=552351d3fb54423ca61cfde06ecec019, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:28.375143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2d20-dbbc-4573-a3c4-aa7078573f1b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:28.388943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 410/817] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:17:28 2022] PUT /identity/v3/projects/24a85598df4d4efb826ab48a27166ae5/users/552351d3fb54423ca61cfde06ecec019/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:17:29.067656 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb718e5-9dc8-442c-9c02-18d66120e5c4 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:29.068230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb718e5-9dc8-442c-9c02-18d66120e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:29.068230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb718e5-9dc8-442c-9c02-18d66120e5c4 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:29.069568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 408/818] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:29.075012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264471da-7ac9-4065-8959-284302eb7e4f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:29.075383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264471da-7ac9-4065-8959-284302eb7e4f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:29.075730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264471da-7ac9-4065-8959-284302eb7e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:29.094622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-264471da-7ac9-4065-8959-284302eb7e4f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:29.095811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-264471da-7ac9-4065-8959-284302eb7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:29.160230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 411/819] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:29.427955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb718e5-9dc8-442c-9c02-18d66120e5c4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:29.446939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:29.530699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb718e5-9dc8-442c-9c02-18d66120e5c4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:29.564120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:29.564753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:29.565037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:29.565341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:29.575239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:29.580349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:29.581384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:29.582754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 409/820] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Oct 12 12:17:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:29.587922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264471da-7ac9-4065-8959-284302eb7e4f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:29.671479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:29.684122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264471da-7ac9-4065-8959-284302eb7e4f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:29.717217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:29.717810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:29.718087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:29.718356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:29.719008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:29.719309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:29.720690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:29.728421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 412/821] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Oct 12 12:17:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:29.734012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:29.812155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:29.834656 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd137a-485a-46e4-a7ed-53ba96983227 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:29.866081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:29.866693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:29.866973 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:29.867241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:29.877306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:29.879268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:29.892748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:29.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:29.895333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:29.895333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:29.895333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:29.895333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 410/822] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:29.900073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:29.996907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95906500-68d8-42b4-ab77-0eff5db4049f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:30.029480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:30.030066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.030344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.030613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.031245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:30.031547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:30.032936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:30.044392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 413/823] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:30.049933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:30.147119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce79364-4c22-4988-ad5e-7d347bcaeb31 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:30.174350 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:30.181079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:30.181704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.181982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.182250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.189555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:30.191032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:17:30.201847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:30.203197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:30.204189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 411/824] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Oct 12 12:17:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:30.209405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:30.221328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:30.305972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbda2c-8e69-4a4f-8bdf-26d9274e22b0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:30.338640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde098-90ce-476c-93e4-7ca4543747be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:30.339238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde098-90ce-476c-93e4-7ca4543747be None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.339519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde098-90ce-476c-93e4-7ca4543747be None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.339790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde098-90ce-476c-93e4-7ca4543747be None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.340542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde098-90ce-476c-93e4-7ca4543747be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:30.340846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde098-90ce-476c-93e4-7ca4543747be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:30.342259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde098-90ce-476c-93e4-7ca4543747be None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:30.359301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 414/825] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Oct 12 12:17:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:30.364941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:30.465550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3dd65-f38f-4389-b471-e7c12d498477 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:30.497424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:30.498028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.498306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.498576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.511085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6833-84a6-4b7c-90f7-498510cf51d3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.511444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6833-84a6-4b7c-90f7-498510cf51d3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.511724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6833-84a6-4b7c-90f7-498510cf51d3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.513114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 415/826] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:17:30.517969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc538-b82c-45fc-9835-b75eabbdfbcb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.518253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc538-b82c-45fc-9835-b75eabbdfbcb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.518527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc538-b82c-45fc-9835-b75eabbdfbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.536716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0b9fc538-b82c-45fc-9835-b75eabbdfbcb None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:30.537911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0b9fc538-b82c-45fc-9835-b75eabbdfbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:30.554658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:30.565510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:30.567413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:30.598402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:30.604159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 416/827] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:17:30.667276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 412/828] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:17:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 12 12:17:30.673268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc538-b82c-45fc-9835-b75eabbdfbcb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:30.770546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc538-b82c-45fc-9835-b75eabbdfbcb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:30.804067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:30.804686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.804963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.805234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.814918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:30.816943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:17:30.831243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:30.832224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:17:30.833647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:17:30.833647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:17:30.833647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:30.833647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 417/829] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:30.837983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:30.873258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:30.922050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:30.926462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:30.937091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44968b-ec72-4801-a8be-2cae838ad4b8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:30.971097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:30.971692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:30.972004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:30.972276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:30.972436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577e7e-2170-4418-83bc-dee02c449934 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:30.972911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:30.973213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:30.975216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:30.985864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 413/830] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:30.992056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.011147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.011782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.012104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.012378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.022880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:31.027655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:31.028609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:31.029451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 418/831] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:31.034613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.089886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862b17f-d0ce-4518-9ba2-09df45649526 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.122762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.123376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.123653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.123952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.130426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.130984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a8865-afee-4315-a6f3-8cde95d578da None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.131879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.141413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:17:31.143147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:31.144271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:31.145204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 414/832] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:17:31.150576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.163140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:31.169360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.169963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.170244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.170519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.171175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:31.171476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.172868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.181736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 419/833] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:31.187460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.251065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5cf50-7d26-488e-a448-3f90e9ee2a24 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.282911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eeec6-b34c-4a0f-9820-999f428df9da None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.283538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.284163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.284448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.285258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.285946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:31.286245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.287646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.299249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 415/834] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:31.306468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.316552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.317173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.317454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.317722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] PATH_INFO: `/v3/users/552351d3fb54423ca61cfde06ecec019` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.318828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] RBAC: Authorizing `identity:get_user(user_id=552351d3fb54423ca61cfde06ecec019)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.320289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.321852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 420/835] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:31 2022] GET /identity/v3/users/552351d3fb54423ca61cfde06ecec019 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:17:31.327667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.368755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:31.375492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:31.405425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc14e1e-0050-4fbc-b31d-53aea7f8ef95 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.426180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a446-cc74-43b5-a02b-2d494392f8b0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.440051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.440651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.440934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.441208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.441935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] RBAC: Adding query filter params (role.id=97d3bcc0648347dca3c54f5645c5227a, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=c01495a37066445293bdb957ece67e20) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:31.442245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.443655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.449261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 416/836] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:17:31 2022] GET /identity/v3/role_assignments?user.id=c01495a37066445293bdb957ece67e20&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=97d3bcc0648347dca3c54f5645c5227a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:31.458792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.459466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.459753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.460052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.532661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.534135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.576440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:31.636111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 421/837] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:17:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 12 12:17:31.642113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.745492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6baaa4-bca6-4d6a-ace9-9b32ee43eb73 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.781611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb34d0-e7f2-465f-a5e8-34c28b64e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.782248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb34d0-e7f2-465f-a5e8-34c28b64e02a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.782531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb34d0-e7f2-465f-a5e8-34c28b64e02a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.782803 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb34d0-e7f2-465f-a5e8-34c28b64e02a None admin] PATH_INFO: `/v3/projects/24a85598df4d4efb826ab48a27166ae5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.783957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb34d0-e7f2-465f-a5e8-34c28b64e02a None admin] RBAC: Authorizing `identity:get_project(project_id=24a85598df4d4efb826ab48a27166ae5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.786027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb34d0-e7f2-465f-a5e8-34c28b64e02a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.787645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 417/838] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:17:31 2022] GET /identity/v3/projects/24a85598df4d4efb826ab48a27166ae5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:31.793966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:31.896152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9178eb-eb11-48ba-8348-c032e5c3372b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:31.929634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48addbeb-e99f-4e92-8147-c49e65ddc3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:31.930241 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addbeb-e99f-4e92-8147-c49e65ddc3ca None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:31.930521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addbeb-e99f-4e92-8147-c49e65ddc3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:31.930794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addbeb-e99f-4e92-8147-c49e65ddc3ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:31.931531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48addbeb-e99f-4e92-8147-c49e65ddc3ca None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=24a85598df4d4efb826ab48a27166ae5, user.id=552351d3fb54423ca61cfde06ecec019) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:31.931871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48addbeb-e99f-4e92-8147-c49e65ddc3ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:31.933292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48addbeb-e99f-4e92-8147-c49e65ddc3ca None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:31.939791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 422/839] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:17:31 2022] GET /identity/v3/role_assignments?user.id=552351d3fb54423ca61cfde06ecec019&scope.project.id=24a85598df4d4efb826ab48a27166ae5&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:34.070351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbd42-951a-4579-9e59-b1bd2f82db73 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:34.070861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbd42-951a-4579-9e59-b1bd2f82db73 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:34.070975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbd42-951a-4579-9e59-b1bd2f82db73 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:34.072261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 418/840] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:34.077760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883c5a-122f-4e67-a70f-6efd7b653200 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:34.078138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883c5a-122f-4e67-a70f-6efd7b653200 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:34.078315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883c5a-122f-4e67-a70f-6efd7b653200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:34.085978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:34.097032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b1883c5a-122f-4e67-a70f-6efd7b653200 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:34.098801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b1883c5a-122f-4e67-a70f-6efd7b653200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:34.161705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 423/841] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:34.430345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbd42-951a-4579-9e59-b1bd2f82db73 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:34.433169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:34.532843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbd42-951a-4579-9e59-b1bd2f82db73 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:34.564571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359903a5-7f8f-45d1-af84-d2f0d2a26b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:34.565180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359903a5-7f8f-45d1-af84-d2f0d2a26b27 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:34.565459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359903a5-7f8f-45d1-af84-d2f0d2a26b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:34.565748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359903a5-7f8f-45d1-af84-d2f0d2a26b27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:34.567445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359903a5-7f8f-45d1-af84-d2f0d2a26b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:34.568895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359903a5-7f8f-45d1-af84-d2f0d2a26b27 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:34.570421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 419/842] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:34.576311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1883c5a-122f-4e67-a70f-6efd7b653200 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:34.670163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1883c5a-122f-4e67-a70f-6efd7b653200 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:34.703877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a0eb-9caf-4c1d-929f-978c4d2fc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:34.704455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a0eb-9caf-4c1d-929f-978c4d2fc0b1 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:34.704739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a0eb-9caf-4c1d-929f-978c4d2fc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:34.705014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a0eb-9caf-4c1d-929f-978c4d2fc0b1 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:34.705673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a0eb-9caf-4c1d-929f-978c4d2fc0b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:34.707102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a0eb-9caf-4c1d-929f-978c4d2fc0b1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:34.715017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:34.728163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 424/843] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:17:34 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:36.869258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3a16-11c4-405b-a450-e6d744f8a343 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:36.869808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3a16-11c4-405b-a450-e6d744f8a343 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:36.869808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3a16-11c4-405b-a450-e6d744f8a343 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:36.871105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 420/844] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:36.876150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3752739-8443-43f0-822f-31ad415fb3ce None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:36.876532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3752739-8443-43f0-822f-31ad415fb3ce None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:36.876707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3752739-8443-43f0-822f-31ad415fb3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:36.894824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a3752739-8443-43f0-822f-31ad415fb3ce None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:36.896078 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a3752739-8443-43f0-822f-31ad415fb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:36.960347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 425/845] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:37.228771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3a16-11c4-405b-a450-e6d744f8a343 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:37.296487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:37.327724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3a16-11c4-405b-a450-e6d744f8a343 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:37.360167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:37.360785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:37.361068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:37.361340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] PATH_INFO: `/v3/roles/1aeee7a88610411d8ff149cc0528f706` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:37.363258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] RBAC: Authorizing `identity:get_role(role_id=1aeee7a88610411d8ff149cc0528f706)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:37.364644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:37.365930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 421/846] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:37 2022] GET /identity/v3/roles/1aeee7a88610411d8ff149cc0528f706 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:37.371564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3752739-8443-43f0-822f-31ad415fb3ce None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:37.465525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3752739-8443-43f0-822f-31ad415fb3ce None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:37.486027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:37.500639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:37.501262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:37.501542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:37.501814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] PATH_INFO: `/v3/users/2427a88da273418590b94756eb16c493` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:37.514256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] RBAC: Authorizing `identity:get_user(user_id=2427a88da273418590b94756eb16c493)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:37.515685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:37.517292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 426/847] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:37 2022] GET /identity/v3/users/2427a88da273418590b94756eb16c493 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:37.523519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:37.618452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939365-3c32-4810-993d-b3e30e6cc82a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:37.650698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb645aeb-8685-49e2-9027-7084789668de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:37.651306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645aeb-8685-49e2-9027-7084789668de None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:37.651585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645aeb-8685-49e2-9027-7084789668de None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:37.651884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645aeb-8685-49e2-9027-7084789668de None admin] PATH_INFO: `/v3/projects/24a85598df4d4efb826ab48a27166ae5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:37.652984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb645aeb-8685-49e2-9027-7084789668de None admin] RBAC: Authorizing `identity:get_project(project_id=24a85598df4d4efb826ab48a27166ae5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:37.654384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb645aeb-8685-49e2-9027-7084789668de None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:37.655991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 422/848] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:17:37 2022] GET /identity/v3/projects/24a85598df4d4efb826ab48a27166ae5 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:37.662377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:37.757266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b816f43-8736-4f99-b9ca-15d62f5bb69a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:37.790861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f54bc-7b10-42b4-b0cc-8529ef94a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:37.791513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f54bc-7b10-42b4-b0cc-8529ef94a566 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:37.791811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f54bc-7b10-42b4-b0cc-8529ef94a566 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:37.792100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f54bc-7b10-42b4-b0cc-8529ef94a566 None admin] PATH_INFO: `/v3/projects/24a85598df4d4efb826ab48a27166ae5/users/2427a88da273418590b94756eb16c493/roles/1aeee7a88610411d8ff149cc0528f706` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:37.794233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f54bc-7b10-42b4-b0cc-8529ef94a566 None admin] RBAC: Authorizing `identity:create_grant(project_id=24a85598df4d4efb826ab48a27166ae5, user_id=2427a88da273418590b94756eb16c493, role_id=1aeee7a88610411d8ff149cc0528f706)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:37.795654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f54bc-7b10-42b4-b0cc-8529ef94a566 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:37.808059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 427/849] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:17:37 2022] PUT /identity/v3/projects/24a85598df4d4efb826ab48a27166ae5/users/2427a88da273418590b94756eb16c493/roles/1aeee7a88610411d8ff149cc0528f706 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:17:39.901236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329084-c3cc-4d42-a356-ced61dd4e901 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:39.901779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329084-c3cc-4d42-a356-ced61dd4e901 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:39.901779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329084-c3cc-4d42-a356-ced61dd4e901 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:39.903093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 423/850] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:39.908416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0665cc-944e-49b5-8374-e131a8ad60f6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:39.908824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0665cc-944e-49b5-8374-e131a8ad60f6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:39.908962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0665cc-944e-49b5-8374-e131a8ad60f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:39.927161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3e0665cc-944e-49b5-8374-e131a8ad60f6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:39.928361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3e0665cc-944e-49b5-8374-e131a8ad60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:39.957111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:39.993394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 428/851] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:40.266731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329084-c3cc-4d42-a356-ced61dd4e901 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:40.276076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:40.365336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329084-c3cc-4d42-a356-ced61dd4e901 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:40.397991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:40.398601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:40.398883 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:40.399156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] PATH_INFO: `/v3/roles/1aeee7a88610411d8ff149cc0528f706` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:40.400548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] RBAC: Authorizing `identity:get_role(role_id=1aeee7a88610411d8ff149cc0528f706)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:40.401899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:40.403165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 424/852] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:40 2022] GET /identity/v3/roles/1aeee7a88610411d8ff149cc0528f706 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:40.408819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0665cc-944e-49b5-8374-e131a8ad60f6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:40.502549 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0665cc-944e-49b5-8374-e131a8ad60f6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:40.534833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:40.535389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:40.535670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:40.535971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] PATH_INFO: `/v3/users/2427a88da273418590b94756eb16c493` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:40.537078 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2427a88da273418590b94756eb16c493)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:40.538491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:40.540107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 429/853] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:40 2022] GET /identity/v3/users/2427a88da273418590b94756eb16c493 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:40.545692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:40.618546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:40.642566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7763-617d-4671-9a9c-83087c83eb59 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:40.674220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:40.674805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:40.675586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:40.675882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:40.740641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:40.742097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:40.813348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:40.838952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 425/854] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:17:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:17:40.844878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:40.879902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:40.941726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeae79-0830-45d4-92c8-0e1dfc0fa5c4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:40.973878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f59d-0af6-45a4-a8a2-485c8c3318d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:40.974491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f59d-0af6-45a4-a8a2-485c8c3318d2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:40.974771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f59d-0af6-45a4-a8a2-485c8c3318d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:40.975044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f59d-0af6-45a4-a8a2-485c8c3318d2 None admin] PATH_INFO: `/v3/projects/24a85598df4d4efb826ab48a27166ae5` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:40.976167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f59d-0af6-45a4-a8a2-485c8c3318d2 None admin] RBAC: Authorizing `identity:get_project(project_id=24a85598df4d4efb826ab48a27166ae5)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:40.977591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f59d-0af6-45a4-a8a2-485c8c3318d2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:40.979191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 430/855] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:17:40 2022] GET /identity/v3/projects/24a85598df4d4efb826ab48a27166ae5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:40.985373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:41.192767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c354-da12-4f21-931b-e3b7e2859754 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:41.225417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1ffde-48d8-4743-b6e6-e7fcab178a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:41.226001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ffde-48d8-4743-b6e6-e7fcab178a21 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:41.226282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ffde-48d8-4743-b6e6-e7fcab178a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:41.226551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ffde-48d8-4743-b6e6-e7fcab178a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:41.227265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1ffde-48d8-4743-b6e6-e7fcab178a21 None admin] RBAC: Adding query filter params (role.id=1aeee7a88610411d8ff149cc0528f706, scope.project.id=24a85598df4d4efb826ab48a27166ae5, user.id=2427a88da273418590b94756eb16c493) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:41.227568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1ffde-48d8-4743-b6e6-e7fcab178a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:41.229006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1ffde-48d8-4743-b6e6-e7fcab178a21 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:41.234484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 426/856] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:17:40 2022] GET /identity/v3/role_assignments?user.id=2427a88da273418590b94756eb16c493&scope.project.id=24a85598df4d4efb826ab48a27166ae5&role.id=1aeee7a88610411d8ff149cc0528f706 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:43.340083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba27b0-7b57-4eb4-9c04-99a27cf482e5 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:43.340640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba27b0-7b57-4eb4-9c04-99a27cf482e5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:43.340640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba27b0-7b57-4eb4-9c04-99a27cf482e5 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:43.341962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 431/857] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:43.347662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35650f8-beba-4f97-980d-d5506fe907ab None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:43.348102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35650f8-beba-4f97-980d-d5506fe907ab None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:43.348231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35650f8-beba-4f97-980d-d5506fe907ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:43.366294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e35650f8-beba-4f97-980d-d5506fe907ab None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:43.367467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e35650f8-beba-4f97-980d-d5506fe907ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:43.395068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:43.430961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 427/858] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:43.693811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba27b0-7b57-4eb4-9c04-99a27cf482e5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:43.793245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba27b0-7b57-4eb4-9c04-99a27cf482e5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:43.795481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:43.825422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e86ef-9bd5-414d-83f7-060054307e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:43.826051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e86ef-9bd5-414d-83f7-060054307e9d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:43.826332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e86ef-9bd5-414d-83f7-060054307e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:43.826604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e86ef-9bd5-414d-83f7-060054307e9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:43.827992 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e86ef-9bd5-414d-83f7-060054307e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:43.829407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e86ef-9bd5-414d-83f7-060054307e9d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:43.830946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 432/859] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:43.837225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35650f8-beba-4f97-980d-d5506fe907ab None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:43.932561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35650f8-beba-4f97-980d-d5506fe907ab None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:43.965401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad962288-b4a1-40bf-8361-cd5216a3fb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:43.965956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad962288-b4a1-40bf-8361-cd5216a3fb17 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:43.966231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad962288-b4a1-40bf-8361-cd5216a3fb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:43.966496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad962288-b4a1-40bf-8361-cd5216a3fb17 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:43.967124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad962288-b4a1-40bf-8361-cd5216a3fb17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:43.968555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad962288-b4a1-40bf-8361-cd5216a3fb17 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:43.993465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 428/860] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:43 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:46.123959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3021-61da-4142-90fb-fad42735ca11 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:46.124514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3021-61da-4142-90fb-fad42735ca11 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:46.124514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3021-61da-4142-90fb-fad42735ca11 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:46.125819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 433/861] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:46.131574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7efc6-3f52-41a8-9d98-462ff88325f1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:46.132030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7efc6-3f52-41a8-9d98-462ff88325f1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:46.132150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7efc6-3f52-41a8-9d98-462ff88325f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:46.150202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5dc7efc6-3f52-41a8-9d98-462ff88325f1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:46.151355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5dc7efc6-3f52-41a8-9d98-462ff88325f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:46.164968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:46.216463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 429/862] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:46.482499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3021-61da-4142-90fb-fad42735ca11 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:46.579621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3021-61da-4142-90fb-fad42735ca11 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:46.611277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40049d4d-8a75-4e2e-97b7-53e3ffcc7130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:46.611910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d4d-8a75-4e2e-97b7-53e3ffcc7130 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:46.612191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d4d-8a75-4e2e-97b7-53e3ffcc7130 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:46.612945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40049d4d-8a75-4e2e-97b7-53e3ffcc7130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:46.614035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049d4d-8a75-4e2e-97b7-53e3ffcc7130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:46.615458 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40049d4d-8a75-4e2e-97b7-53e3ffcc7130 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:46.617018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 434/863] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:17:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:46.622586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7efc6-3f52-41a8-9d98-462ff88325f1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:46.716849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7efc6-3f52-41a8-9d98-462ff88325f1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:46.748767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432c56b-540a-4a7d-849e-bab25b39b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:46.749303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c56b-540a-4a7d-849e-bab25b39b411 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:46.749580 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c56b-540a-4a7d-849e-bab25b39b411 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:46.749847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c56b-540a-4a7d-849e-bab25b39b411 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:46.750485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432c56b-540a-4a7d-849e-bab25b39b411 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:46.751915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432c56b-540a-4a7d-849e-bab25b39b411 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:46.773659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 430/864] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:17:46 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:48.900737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118785-c994-469f-a42d-37c53b3d2d6f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:48.901274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118785-c994-469f-a42d-37c53b3d2d6f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:48.901274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118785-c994-469f-a42d-37c53b3d2d6f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:48.902598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 435/865] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:48.907757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4034796-a049-4f2d-b9e8-a398653d3aac None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:48.908183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4034796-a049-4f2d-b9e8-a398653d3aac None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:48.908342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4034796-a049-4f2d-b9e8-a398653d3aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:48.921670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:48.927968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a4034796-a049-4f2d-b9e8-a398653d3aac None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:48.929271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a4034796-a049-4f2d-b9e8-a398653d3aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:48.992603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 431/866] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:49.269623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118785-c994-469f-a42d-37c53b3d2d6f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:49.315994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:49.375815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118785-c994-469f-a42d-37c53b3d2d6f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:49.409718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:49.410344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:49.410627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:49.410893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:49.421093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:49.426497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:49.427663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:17:49.428826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 436/867] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:49.433879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4034796-a049-4f2d-b9e8-a398653d3aac None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:49.533183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4034796-a049-4f2d-b9e8-a398653d3aac None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:49.566123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:49.566718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:49.566992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:49.567258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:49.567939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:49.568236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:49.569607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:49.571660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:49.578262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 432/868] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:49.584830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:49.679103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:49.682013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d6f13-d367-4525-99c5-32206523275c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:49.714687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:49.715290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:49.715568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:49.715862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] PATH_INFO: `/v3/users/aa97eff5eb2f469bb9a344557b937d06` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:49.729030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] RBAC: Authorizing `identity:get_user(user_id=aa97eff5eb2f469bb9a344557b937d06)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:49.730469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:49.732078 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 437/869] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:49 2022] GET /identity/v3/users/aa97eff5eb2f469bb9a344557b937d06 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:49.737665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:49.833374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25b75f-c5b4-4580-8456-1f2afa70020e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:49.865394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715530fa-3998-4e95-bd36-3de235a691ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:49.866011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715530fa-3998-4e95-bd36-3de235a691ad None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:49.866295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715530fa-3998-4e95-bd36-3de235a691ad None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:49.866567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715530fa-3998-4e95-bd36-3de235a691ad None admin] PATH_INFO: `/v3/projects/1aa3eb2cc4cc40968cc02569ddaa992e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:49.867668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715530fa-3998-4e95-bd36-3de235a691ad None admin] RBAC: Authorizing `identity:get_project(project_id=1aa3eb2cc4cc40968cc02569ddaa992e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:49.869111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715530fa-3998-4e95-bd36-3de235a691ad None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:49.870727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 433/870] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:17:49 2022] GET /identity/v3/projects/1aa3eb2cc4cc40968cc02569ddaa992e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:49.876506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:49.972137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162ae5-36fb-444b-bd82-7971c7a35d55 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:50.004354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aba10-1b51-4f1b-8d4f-6635b4eb9322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:50.004994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aba10-1b51-4f1b-8d4f-6635b4eb9322 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:50.005276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aba10-1b51-4f1b-8d4f-6635b4eb9322 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:50.005550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aba10-1b51-4f1b-8d4f-6635b4eb9322 None admin] PATH_INFO: `/v3/projects/1aa3eb2cc4cc40968cc02569ddaa992e/users/aa97eff5eb2f469bb9a344557b937d06/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:50.007427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aba10-1b51-4f1b-8d4f-6635b4eb9322 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aa3eb2cc4cc40968cc02569ddaa992e, user_id=aa97eff5eb2f469bb9a344557b937d06, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:50.008887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aba10-1b51-4f1b-8d4f-6635b4eb9322 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:50.021935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 438/871] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:17:49 2022] PUT /identity/v3/projects/1aa3eb2cc4cc40968cc02569ddaa992e/users/aa97eff5eb2f469bb9a344557b937d06/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:17:52.115267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647438d-5215-47e9-b596-c752f4702a62 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:52.115821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647438d-5215-47e9-b596-c752f4702a62 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:52.115821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647438d-5215-47e9-b596-c752f4702a62 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:52.117160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 434/872] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:52.122396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d9158-c303-417e-907b-ad4933f3c32e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:52.122785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d9158-c303-417e-907b-ad4933f3c32e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:52.122951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d9158-c303-417e-907b-ad4933f3c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:52.141439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8d0d9158-c303-417e-907b-ad4933f3c32e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:52.142617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8d0d9158-c303-417e-907b-ad4933f3c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:52.155142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:52.208052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 439/873] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:52.476450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647438d-5215-47e9-b596-c752f4702a62 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:52.540599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:52.574675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647438d-5215-47e9-b596-c752f4702a62 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:52.607500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:52.608133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:52.608412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:52.608683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:52.618326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:17:52.623075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:17:52.624115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:17:52.624945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 435/874] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:17:52.630207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d9158-c303-417e-907b-ad4933f3c32e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:52.724975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d9158-c303-417e-907b-ad4933f3c32e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:52.756553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:52.757096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:52.757377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:52.757653 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:52.758305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:52.758605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:52.759997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:52.767894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 440/875] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:52.774243 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:52.869852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f43de6-4322-4e8e-87f2-e7116863eb63 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:52.894728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:52.903284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:52.903925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:52.904214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:52.904469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] PATH_INFO: `/v3/users/aa97eff5eb2f469bb9a344557b937d06` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:52.905566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] RBAC: Authorizing `identity:get_user(user_id=aa97eff5eb2f469bb9a344557b937d06)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:52.906976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:52.908541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 436/876] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:17:52 2022] GET /identity/v3/users/aa97eff5eb2f469bb9a344557b937d06 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:52.914462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:52.926770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:53.011193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719efc6-1379-4014-9f3f-5495257e938b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:53.044413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:53.045006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:53.045288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:53.045560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:53.109071 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:53.110495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:53.120867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:53.204623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 441/877] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:17:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:17:53.211126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:53.306204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e402-0014-4c62-983a-b7b6ff8438ac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:53.338473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bb3e7-0d5e-4a34-bb0c-82b44dcef961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:53.339078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb3e7-0d5e-4a34-bb0c-82b44dcef961 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:53.339356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb3e7-0d5e-4a34-bb0c-82b44dcef961 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:53.339629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb3e7-0d5e-4a34-bb0c-82b44dcef961 None admin] PATH_INFO: `/v3/projects/1aa3eb2cc4cc40968cc02569ddaa992e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:53.340752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bb3e7-0d5e-4a34-bb0c-82b44dcef961 None admin] RBAC: Authorizing `identity:get_project(project_id=1aa3eb2cc4cc40968cc02569ddaa992e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:53.342169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bb3e7-0d5e-4a34-bb0c-82b44dcef961 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:53.343719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 437/878] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:17:53 2022] GET /identity/v3/projects/1aa3eb2cc4cc40968cc02569ddaa992e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:53.349586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:53.444173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972d02-1288-419e-aeb4-3ae91ca44255 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:53.454611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:53.477239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b2a9d-7a0a-4f2e-8f92-13559a16462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:53.477830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2a9d-7a0a-4f2e-8f92-13559a16462d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:53.478113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2a9d-7a0a-4f2e-8f92-13559a16462d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:53.478387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2a9d-7a0a-4f2e-8f92-13559a16462d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:53.479112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2a9d-7a0a-4f2e-8f92-13559a16462d None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=1aa3eb2cc4cc40968cc02569ddaa992e, user.id=aa97eff5eb2f469bb9a344557b937d06) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:17:53.479419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2a9d-7a0a-4f2e-8f92-13559a16462d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:53.480865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2a9d-7a0a-4f2e-8f92-13559a16462d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:53.486460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 442/879] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:17:53 2022] GET /identity/v3/role_assignments?user.id=aa97eff5eb2f469bb9a344557b937d06&scope.project.id=1aa3eb2cc4cc40968cc02569ddaa992e&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:55.597178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d821c7-e293-4fb3-9520-c9f12c29efe9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:55.597722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d821c7-e293-4fb3-9520-c9f12c29efe9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:55.597722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d821c7-e293-4fb3-9520-c9f12c29efe9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:55.599028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 438/880] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:55.604313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576923e-8186-4ef9-8388-487dfa8235f8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:55.604711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576923e-8186-4ef9-8388-487dfa8235f8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:55.604856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576923e-8186-4ef9-8388-487dfa8235f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:55.622815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5576923e-8186-4ef9-8388-487dfa8235f8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:55.624011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5576923e-8186-4ef9-8388-487dfa8235f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:55.688268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 443/881] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:55.956796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d821c7-e293-4fb3-9520-c9f12c29efe9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:56.016627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:56.054732 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d821c7-e293-4fb3-9520-c9f12c29efe9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:56.086413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d230-6e1a-4cda-97ab-2da332ce4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:56.086996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d230-6e1a-4cda-97ab-2da332ce4c08 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:56.087274 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d230-6e1a-4cda-97ab-2da332ce4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:56.087543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d230-6e1a-4cda-97ab-2da332ce4c08 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:56.088227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d230-6e1a-4cda-97ab-2da332ce4c08 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:56.089575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d230-6e1a-4cda-97ab-2da332ce4c08 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:56.104598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 439/882] 10.222.0.45 () {60 vars in 1138 bytes} [Wed Oct 12 12:17:55 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:17:58.258752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c3611-b7e6-4be4-841e-d2df00b7d593 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:58.259385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c3611-b7e6-4be4-841e-d2df00b7d593 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:58.259385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c3611-b7e6-4be4-841e-d2df00b7d593 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:58.260658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 444/883] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:17:58.265916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6f516-8bb5-4e92-980f-03bcca2206dd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:58.266338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6f516-8bb5-4e92-980f-03bcca2206dd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:58.266469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6f516-8bb5-4e92-980f-03bcca2206dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:58.284579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1ad6f516-8bb5-4e92-980f-03bcca2206dd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:17:58.285750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1ad6f516-8bb5-4e92-980f-03bcca2206dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:17:58.348905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 440/884] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:17:58.617639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c3611-b7e6-4be4-841e-d2df00b7d593 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:58.714575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c3611-b7e6-4be4-841e-d2df00b7d593 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:58.716816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:58.746816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18faa32-555a-45b6-97db-e11e2e1af819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:58.747421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18faa32-555a-45b6-97db-e11e2e1af819 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:58.747698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18faa32-555a-45b6-97db-e11e2e1af819 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:58.747997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18faa32-555a-45b6-97db-e11e2e1af819 None admin] PATH_INFO: `/v3/domains/6cbd372a061c45febe70eae6bce0d2d1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:58.757847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18faa32-555a-45b6-97db-e11e2e1af819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6cbd372a061c45febe70eae6bce0d2d1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:58.759270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18faa32-555a-45b6-97db-e11e2e1af819 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:58.760865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 445/885] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Oct 12 12:17:58 2022] GET /identity/v3/domains/6cbd372a061c45febe70eae6bce0d2d1 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:17:58.766612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6f516-8bb5-4e92-980f-03bcca2206dd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:17:58.817159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:17:58.863643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6f516-8bb5-4e92-980f-03bcca2206dd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:17:58.896290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30009f3f-ca59-4fd3-9644-4aed16d9fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:17:58.896826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30009f3f-ca59-4fd3-9644-4aed16d9fc19 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:17:58.897103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30009f3f-ca59-4fd3-9644-4aed16d9fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:17:58.897369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30009f3f-ca59-4fd3-9644-4aed16d9fc19 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:17:58.898014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30009f3f-ca59-4fd3-9644-4aed16d9fc19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:17:58.899424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30009f3f-ca59-4fd3-9644-4aed16d9fc19 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:17:58.924826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 441/886] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:17:58 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:18:01.068687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b3f92-289a-4cf1-8fee-ae4d0ac4ea25 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:01.069235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b3f92-289a-4cf1-8fee-ae4d0ac4ea25 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:01.069235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b3f92-289a-4cf1-8fee-ae4d0ac4ea25 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:01.070550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 446/887] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:18:01.075644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9df50-9c73-4134-81be-f269975ff6fd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:01.076189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9df50-9c73-4134-81be-f269975ff6fd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:01.076291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9df50-9c73-4134-81be-f269975ff6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:01.094746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-abc9df50-9c73-4134-81be-f269975ff6fd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:18:01.095953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-abc9df50-9c73-4134-81be-f269975ff6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:18:01.161383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 442/888] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:18:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:18:01.428948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b3f92-289a-4cf1-8fee-ae4d0ac4ea25 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:01.525912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b3f92-289a-4cf1-8fee-ae4d0ac4ea25 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:01.557844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703798e2-5702-44d2-a64e-c5ca97558ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:01.558449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703798e2-5702-44d2-a64e-c5ca97558ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:01.558725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703798e2-5702-44d2-a64e-c5ca97558ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:01.558991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703798e2-5702-44d2-a64e-c5ca97558ad2 None admin] PATH_INFO: `/v3/domains/6cbd372a061c45febe70eae6bce0d2d1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:01.560099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703798e2-5702-44d2-a64e-c5ca97558ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6cbd372a061c45febe70eae6bce0d2d1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:01.561506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703798e2-5702-44d2-a64e-c5ca97558ad2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:01.563030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 447/889] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Oct 12 12:18:01 2022] GET /identity/v3/domains/6cbd372a061c45febe70eae6bce0d2d1 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:18:01.568870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9df50-9c73-4134-81be-f269975ff6fd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:01.601957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:01.666047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9df50-9c73-4134-81be-f269975ff6fd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:01.698010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8c32-e2c5-4014-9902-c10335f04fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:01.698550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8c32-e2c5-4014-9902-c10335f04fc0 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:01.698832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8c32-e2c5-4014-9902-c10335f04fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:01.699102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8c32-e2c5-4014-9902-c10335f04fc0 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:01.699741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8c32-e2c5-4014-9902-c10335f04fc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:01.701198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8c32-e2c5-4014-9902-c10335f04fc0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:01.722480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 443/890] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:18:01 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:18:03.854448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb918bf-b8d2-4a3a-8e98-6f85fc39745d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:03.854960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb918bf-b8d2-4a3a-8e98-6f85fc39745d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:03.855057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb918bf-b8d2-4a3a-8e98-6f85fc39745d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:03.856349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 448/891] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:18:03.861375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819bb10-ea2f-47b9-96ab-f48abc077078 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:03.861777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819bb10-ea2f-47b9-96ab-f48abc077078 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:03.861976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819bb10-ea2f-47b9-96ab-f48abc077078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:03.880332 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c819bb10-ea2f-47b9-96ab-f48abc077078 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:18:03.881495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c819bb10-ea2f-47b9-96ab-f48abc077078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:18:03.944487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 444/892] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:18:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:18:04.208761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb918bf-b8d2-4a3a-8e98-6f85fc39745d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:04.238456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:04.306325 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb918bf-b8d2-4a3a-8e98-6f85fc39745d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:04.339445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:04.340082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:04.340364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:04.340634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:04.350316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:18:04.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:18:04.356215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:18:04.357320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 449/893] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:18:04.362244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819bb10-ea2f-47b9-96ab-f48abc077078 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:04.382897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:04.457534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819bb10-ea2f-47b9-96ab-f48abc077078 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:04.489939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:04.490472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:04.490749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:04.491019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:04.491678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:18:04.492080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:04.493441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:04.501061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 445/894] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:18:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:18:04.507267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:04.594469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:04.603264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce35190-7a8e-4332-8d9f-ee4aa1bb1a04 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:04.636056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:04.636676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:04.636959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:04.637235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] PATH_INFO: `/v3/users/acda2c2c091c481cbb83897615f8c855` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:04.649766 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] RBAC: Authorizing `identity:get_user(user_id=acda2c2c091c481cbb83897615f8c855)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:04.651202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:04.652870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 450/895] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:18:04 2022] GET /identity/v3/users/acda2c2c091c481cbb83897615f8c855 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:18:04.658450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:04.736348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:04.755032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2a35-504b-4b16-9553-a3d37f00279d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:04.786832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347499e3-06ad-49e0-b0bd-ff357ec6d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:04.787451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347499e3-06ad-49e0-b0bd-ff357ec6d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:04.787733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347499e3-06ad-49e0-b0bd-ff357ec6d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:04.788043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347499e3-06ad-49e0-b0bd-ff357ec6d3d9 None admin] PATH_INFO: `/v3/projects/45059d693b53498b8ff945a338c010d7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:04.789140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347499e3-06ad-49e0-b0bd-ff357ec6d3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=45059d693b53498b8ff945a338c010d7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:04.790555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347499e3-06ad-49e0-b0bd-ff357ec6d3d9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:04.792363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 446/896] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:18:04 2022] GET /identity/v3/projects/45059d693b53498b8ff945a338c010d7 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:18:04.798028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:04.895112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204a56-132e-4784-90fb-d7f6d716f9ca None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:04.928506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9e859-5ced-4a34-9aeb-824773c973bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:04.929151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9e859-5ced-4a34-9aeb-824773c973bb None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:04.929434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9e859-5ced-4a34-9aeb-824773c973bb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:04.929710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9e859-5ced-4a34-9aeb-824773c973bb None admin] PATH_INFO: `/v3/projects/45059d693b53498b8ff945a338c010d7/users/acda2c2c091c481cbb83897615f8c855/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:04.931589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9e859-5ced-4a34-9aeb-824773c973bb None admin] RBAC: Authorizing `identity:create_grant(project_id=45059d693b53498b8ff945a338c010d7, user_id=acda2c2c091c481cbb83897615f8c855, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:04.933046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9e859-5ced-4a34-9aeb-824773c973bb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:04.946521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 451/897] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:18:04 2022] PUT /identity/v3/projects/45059d693b53498b8ff945a338c010d7/users/acda2c2c091c481cbb83897615f8c855/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:18:07.052109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e581bd-f0f0-414a-b3ab-0cd85260832f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:07.052629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e581bd-f0f0-414a-b3ab-0cd85260832f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:07.052629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e581bd-f0f0-414a-b3ab-0cd85260832f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:07.053933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 447/898] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:18:07.059403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c5c7-fe83-455b-ae7f-c500dd129b73 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:07.059838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c5c7-fe83-455b-ae7f-c500dd129b73 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:07.059985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c5c7-fe83-455b-ae7f-c500dd129b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:07.078385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-eaf6c5c7-fe83-455b-ae7f-c500dd129b73 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:18:07.079563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-eaf6c5c7-fe83-455b-ae7f-c500dd129b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:18:07.082263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:07.144052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 452/899] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:18:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:18:07.408251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e581bd-f0f0-414a-b3ab-0cd85260832f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:07.507847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e581bd-f0f0-414a-b3ab-0cd85260832f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:07.540722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:07.541337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:07.541620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:07.541891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:07.551606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:18:07.556366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:18:07.557426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:18:07.558336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 448/900] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:18:07.563463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6c5c7-fe83-455b-ae7f-c500dd129b73 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:07.658120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6c5c7-fe83-455b-ae7f-c500dd129b73 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:07.690740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:07.691275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:07.691557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:07.691854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:07.692511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:18:07.692814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:07.694170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:07.701896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 453/901] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:18:07.708921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:07.720543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:07.804336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d6ba-0bc5-47f5-9f19-693663a8b0bb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:07.836536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:07.837151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:07.837428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:07.837694 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] PATH_INFO: `/v3/users/acda2c2c091c481cbb83897615f8c855` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:07.838782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] RBAC: Authorizing `identity:get_user(user_id=acda2c2c091c481cbb83897615f8c855)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:07.840221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:07.841777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 449/902] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Oct 12 12:18:07 2022] GET /identity/v3/users/acda2c2c091c481cbb83897615f8c855 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:18:07.848104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:07.850892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:07.945067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35385f23-d890-405a-bb35-dd084aa25f8a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:07.977265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:07.977857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:07.978142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:07.978416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:08.042370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:08.043821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:08.045534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:08.138576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 454/903] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:18:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:18:08.145067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:08.219497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:08.240529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d5ae9-b520-4843-b6e5-529d21ba5a61 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:08.272720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b58cb1-712c-400c-8e88-75c3f54beadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:08.273323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b58cb1-712c-400c-8e88-75c3f54beadf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:08.273599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b58cb1-712c-400c-8e88-75c3f54beadf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:08.273865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b58cb1-712c-400c-8e88-75c3f54beadf None admin] PATH_INFO: `/v3/projects/45059d693b53498b8ff945a338c010d7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:08.274943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b58cb1-712c-400c-8e88-75c3f54beadf None admin] RBAC: Authorizing `identity:get_project(project_id=45059d693b53498b8ff945a338c010d7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:08.276378 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b58cb1-712c-400c-8e88-75c3f54beadf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:08.277938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 450/904] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Oct 12 12:18:08 2022] GET /identity/v3/projects/45059d693b53498b8ff945a338c010d7 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:18:08.283943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:18:08.378716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ac195-beec-427f-8f4c-1c0ae8005c23 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:18:08.380202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:08.412156 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05486fd-26c5-4afb-a868-c128a261dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:18:08.412736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05486fd-26c5-4afb-a868-c128a261dd67 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:18:08.413014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05486fd-26c5-4afb-a868-c128a261dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:18:08.413282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05486fd-26c5-4afb-a868-c128a261dd67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:18:08.413996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05486fd-26c5-4afb-a868-c128a261dd67 None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=45059d693b53498b8ff945a338c010d7, user.id=acda2c2c091c481cbb83897615f8c855) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:18:08.414298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05486fd-26c5-4afb-a868-c128a261dd67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:18:08.415693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05486fd-26c5-4afb-a868-c128a261dd67 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:18:08.421157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 455/905] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:18:08 2022] GET /identity/v3/role_assignments?user.id=acda2c2c091c481cbb83897615f8c855&scope.project.id=45059d693b53498b8ff945a338c010d7&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:18:18.268900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=27 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:18:18.418643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=17 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:03.217088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea5da-82a7-4933-b225-ed470087aa3d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:03.217778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea5da-82a7-4933-b225-ed470087aa3d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:03.217778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea5da-82a7-4933-b225-ed470087aa3d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:03.218949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 451/906] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:19:03.227007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eef0a-13c6-4739-9cdc-ab09b9ba8bcf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:03.227538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eef0a-13c6-4739-9cdc-ab09b9ba8bcf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:03.227642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eef0a-13c6-4739-9cdc-ab09b9ba8bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:03.255000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-734eef0a-13c6-4739-9cdc-ab09b9ba8bcf None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:03.256881 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-734eef0a-13c6-4739-9cdc-ab09b9ba8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:03.344970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 456/907] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:03.641475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffea5da-82a7-4933-b225-ed470087aa3d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:03.783178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffea5da-82a7-4933-b225-ed470087aa3d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:03.825580 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:03.826211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:03.826492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:03.826900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:03.840766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:03.842409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:03.861902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:03.863444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:03.864467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:03.864467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:03.864467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:03.868918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 452/908] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:03.870138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eef0a-13c6-4739-9cdc-ab09b9ba8bcf None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:03.997476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eef0a-13c6-4739-9cdc-ab09b9ba8bcf None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:04.030811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:04.037105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f0dfd-34f2-4217-99b6-1ef8f7e009bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:04.037866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f0dfd-34f2-4217-99b6-1ef8f7e009bc None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:04.038279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f0dfd-34f2-4217-99b6-1ef8f7e009bc None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:04.038563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f0dfd-34f2-4217-99b6-1ef8f7e009bc None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:04.039270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f0dfd-34f2-4217-99b6-1ef8f7e009bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:04.039654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f0dfd-34f2-4217-99b6-1ef8f7e009bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:04.041187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f0dfd-34f2-4217-99b6-1ef8f7e009bc None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:04.058745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 457/909] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:19:04.064409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:04.131185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:04.192453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3802f-364e-4f05-8389-238d13aeaeab None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:04.233604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad806ab-7024-44f3-8c56-edb99e60b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:04.234277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad806ab-7024-44f3-8c56-edb99e60b678 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:04.234471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad806ab-7024-44f3-8c56-edb99e60b678 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:04.234740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad806ab-7024-44f3-8c56-edb99e60b678 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:04.235380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad806ab-7024-44f3-8c56-edb99e60b678 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:04.236828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad806ab-7024-44f3-8c56-edb99e60b678 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:04.273153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 453/910] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Oct 12 12:19:04 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:19:06.769330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe2be-21c1-4630-90e7-7729cc161c3c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:06.769911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe2be-21c1-4630-90e7-7729cc161c3c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:06.769911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe2be-21c1-4630-90e7-7729cc161c3c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:06.771613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 458/911] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:19:06.778018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69e761-efd3-4f88-9e57-e56a8093a982 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:06.779324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69e761-efd3-4f88-9e57-e56a8093a982 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:06.779324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69e761-efd3-4f88-9e57-e56a8093a982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:06.800951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fc69e761-efd3-4f88-9e57-e56a8093a982 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:06.802442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fc69e761-efd3-4f88-9e57-e56a8093a982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:06.887392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 454/912] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:07.200014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe2be-21c1-4630-90e7-7729cc161c3c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:07.317674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe2be-21c1-4630-90e7-7729cc161c3c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:07.360394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:07.361054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:07.361339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:07.361614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:07.372845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:19:07.378125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:07.379096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:07.380634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 459/913] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:07.386706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69e761-efd3-4f88-9e57-e56a8093a982 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:07.431674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:07.519094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69e761-efd3-4f88-9e57-e56a8093a982 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:07.563045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:07.564017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:07.564300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:07.564580 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:07.565298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:07.565624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:07.567026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:07.580059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 455/914] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:19:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:07.583406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:07.645604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:07.705460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815acfa-358b-4974-9f75-c5f7b80a6f35 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:07.746058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:07.746758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:07.747044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:07.747333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:07.762205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:07.763978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:07.782244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:07.783668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:07.785182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:07.785182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:07.785182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:07.788681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 460/915] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:07.790423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:07.902776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:07.906079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103b754-301a-4fab-a1f1-ee75ca69772e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:07.942105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:07.942709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:07.942987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:07.943256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:07.943929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:07.944230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:07.945592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:07.959431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 456/916] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:07.966558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:08.084938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bb405-4d99-4ccc-9aab-b55a22e08103 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:08.086545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:08.123453 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:08.124583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:08.124583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:08.124794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:08.133528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:08.135067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:19:08.146974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:08.148269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:08.149424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 461/917] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:08.154018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:08.262014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619eb2-cf6d-4456-9082-6414857a3642 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:08.299926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:08.300571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:08.300848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:08.301115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:08.301840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:08.302138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:08.303542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:08.323866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 457/918] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 12 12:19:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:08.327437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:08.443250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f15b9-8b42-4209-b4b4-9d251dc75105 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:08.485000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:08.485772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:08.486309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:08.486627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:08.504926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:08.506371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:08.523498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:08.524726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:08.526208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:08.526208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:08.526208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:08.526208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 462/919] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:08.531169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:08.554377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:08.658561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee63bd4-1646-42f6-9bf2-695851234793 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:08.704549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:08.705387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:08.705688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:08.706012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:08.706842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:08.707151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:08.708644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:08.720565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 458/920] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:08.726484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:08.744702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:08.842417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5f0a8-caf2-4539-af03-ce0d35a7c5f5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:08.889827 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:08.890561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:08.890946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:08.891207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:08.898750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:08.900343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:19:08.912377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:08.913351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:08.914249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 463/921] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:08.919225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:09.008868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:09.034727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47c80-a183-4b98-a518-bbfce77b46c7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:09.074346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799432-4146-4ebb-b028-1f503c2af134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:09.074973 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799432-4146-4ebb-b028-1f503c2af134 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:09.075299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799432-4146-4ebb-b028-1f503c2af134 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:09.075548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799432-4146-4ebb-b028-1f503c2af134 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:09.076276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799432-4146-4ebb-b028-1f503c2af134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:09.076580 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799432-4146-4ebb-b028-1f503c2af134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:09.078100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799432-4146-4ebb-b028-1f503c2af134 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:09.094355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 459/922] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:09.101871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:09.200473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:09.235127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8183ed5-fd59-4b4b-9098-17485f8eecf3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:09.276926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742d07-8ed3-4831-9b55-1f5fa4956699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:09.277845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742d07-8ed3-4831-9b55-1f5fa4956699 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:09.278335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742d07-8ed3-4831-9b55-1f5fa4956699 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:09.278760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742d07-8ed3-4831-9b55-1f5fa4956699 None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/48cdf9ded77746a793b76d2df4940d63/roles/4419e40f34ef48d3875a6b7cf51a528b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:09.294017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742d07-8ed3-4831-9b55-1f5fa4956699 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=48cdf9ded77746a793b76d2df4940d63, role_id=4419e40f34ef48d3875a6b7cf51a528b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:09.295561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742d07-8ed3-4831-9b55-1f5fa4956699 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:09.308262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 464/923] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:19:09 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/48cdf9ded77746a793b76d2df4940d63/roles/4419e40f34ef48d3875a6b7cf51a528b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:19:11.805128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68928fc-e91f-44be-badc-de94ea7e6925 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:11.805638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68928fc-e91f-44be-badc-de94ea7e6925 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:11.805781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68928fc-e91f-44be-badc-de94ea7e6925 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:11.806986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 460/924] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:19:11.812833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8658d-bec9-4ff3-b5af-677dc5e9a9d2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:11.813294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8658d-bec9-4ff3-b5af-677dc5e9a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:11.813488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8658d-bec9-4ff3-b5af-677dc5e9a9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:11.833387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e1f8658d-bec9-4ff3-b5af-677dc5e9a9d2 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:11.834778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e1f8658d-bec9-4ff3-b5af-677dc5e9a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:11.908614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 465/925] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:12.180435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68928fc-e91f-44be-badc-de94ea7e6925 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:12.292827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68928fc-e91f-44be-badc-de94ea7e6925 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:12.332020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:12.333731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:12.333731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:12.333731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:12.341620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:12.346177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:19:12.352447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:12.353419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:12.354307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 461/926] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Oct 12 12:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:12.360185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8658d-bec9-4ff3-b5af-677dc5e9a9d2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:12.416304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:12.466500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8658d-bec9-4ff3-b5af-677dc5e9a9d2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:12.504646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:12.505300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:12.505619 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:12.505950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:12.506711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:12.507041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:12.508840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:12.517934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 466/927] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Oct 12 12:19:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:12.524607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:12.625959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc28b-978f-4fb6-9a3c-35bf18f2c6d6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:12.660818 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:12.661434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:12.661713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:12.661999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:12.672226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:12.673658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:12.687998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:12.689156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:12.690081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:12.690081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:12.690081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:12.690081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 462/928] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:12.695553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:12.801700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a9803-e336-49e3-b856-2350a2f516b2 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:12.818849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:12.839689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:12.840315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:12.840646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:12.840918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:12.841783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:12.842128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:12.845210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:12.857772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 467/929] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:12.864280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:12.916222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:12.972830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9eef-8f8c-40bb-b5ed-e1d8db3b0b7e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:13.007646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:13.008295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:13.008573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:13.008840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:13.016515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:13.017934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:19:13.029959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:13.036136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:13.037393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 463/930] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:13.038124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:13.145807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ac75-4871-40c2-ae51-d52b9b2d26f6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:13.180572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:13.181166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:13.181442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:13.181709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:13.182435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:13.182735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:13.184186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:13.200641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 468/931] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 12 12:19:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:13.207144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:13.316912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887caa-1da5-4ab2-ab8d-d73a495ec653 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:13.328448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:13.354266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:13.354955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:13.355314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:13.355592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:13.433130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:13.434574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:13.547499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 464/932] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:19:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:19:13.553283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:13.588918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:13.658771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba2bd-4fbe-4e1f-8f59-fd6c6774103e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:13.695059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:13.695677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:13.695978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:13.696245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:13.708178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:13.709897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:13.726981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:13.732733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:13.733830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:13.733830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:13.733830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:13.733830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 469/933] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:19:13.734119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:13.746629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:13.854390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064413d-cf7f-4d90-830a-b7765f91126e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:13.890429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:13.891143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:13.891306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:13.891578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:13.892261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:13.892614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:13.894494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:13.906420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 465/934] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:19:13.912809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:14.004063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:14.022215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b407-a363-45dd-b48a-4255569f4b89 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:14.057905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:14.058709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:14.059004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:14.059433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:14.068216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:14.069666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:19:14.082153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:14.083248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:14.084253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 470/935] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:14.090718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:14.167851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:14.198049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b33fe-df86-4bc2-8ec5-17ccc4d22a30 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:14.233487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8ebdd-78af-4934-9e83-341137fb2d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:14.234345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8ebdd-78af-4934-9e83-341137fb2d10 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:14.234622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8ebdd-78af-4934-9e83-341137fb2d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:14.234886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8ebdd-78af-4934-9e83-341137fb2d10 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:14.235576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8ebdd-78af-4934-9e83-341137fb2d10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:14.235906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8ebdd-78af-4934-9e83-341137fb2d10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:14.238734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8ebdd-78af-4934-9e83-341137fb2d10 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:14.254224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 466/936] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:19:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:14.260242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:14.378306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6544d-a45a-4073-ab97-5a131719ca52 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:14.418113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d9733-74e2-4cfc-956f-8c425461198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:14.418653 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9733-74e2-4cfc-956f-8c425461198f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:14.418936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9733-74e2-4cfc-956f-8c425461198f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:14.419218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9733-74e2-4cfc-956f-8c425461198f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:14.419995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d9733-74e2-4cfc-956f-8c425461198f None admin] RBAC: Adding query filter params (role.id=4419e40f34ef48d3875a6b7cf51a528b, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=48cdf9ded77746a793b76d2df4940d63) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:14.420307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d9733-74e2-4cfc-956f-8c425461198f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:14.421746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d9733-74e2-4cfc-956f-8c425461198f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:14.428814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 471/937] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:19:14 2022] GET /identity/v3/role_assignments?user.id=48cdf9ded77746a793b76d2df4940d63&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=4419e40f34ef48d3875a6b7cf51a528b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:16.608684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978bac-2f54-44e5-880b-128706b5f50e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:16.609214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978bac-2f54-44e5-880b-128706b5f50e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:16.609214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978bac-2f54-44e5-880b-128706b5f50e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:16.610660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 467/938] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:19:16.616398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d3c7d-94c1-4551-98b2-f6d499648533 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:16.617083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d3c7d-94c1-4551-98b2-f6d499648533 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:16.617083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d3c7d-94c1-4551-98b2-f6d499648533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:16.638809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-474d3c7d-94c1-4551-98b2-f6d499648533 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:16.640799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-474d3c7d-94c1-4551-98b2-f6d499648533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:16.644135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:16.717021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 472/939] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:16.985574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2978bac-2f54-44e5-880b-128706b5f50e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:17.093348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2978bac-2f54-44e5-880b-128706b5f50e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:17.121255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:17.128539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:17.129165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:17.129448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:17.129721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:17.140694 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:19:17.146139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:17.147203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:17.148196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 468/940] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:17.153560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d3c7d-94c1-4551-98b2-f6d499648533 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:17.265602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d3c7d-94c1-4551-98b2-f6d499648533 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:17.304708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:17.305701 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:17.306171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:17.306636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:17.307674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:17.308123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:17.309972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:17.321880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 473/941] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:17.328524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:17.436971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404322d-7196-40ed-8d00-0b46b5464411 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:17.474787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:17.475601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:17.475808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:17.476118 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:17.488740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:17.490512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:17.507726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:17.508952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:17.510065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:17.510065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:17.510065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:17.510065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 469/942] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:17.515856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:17.519427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:17.628801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0dfc-2d6d-4011-8917-e5bc463d9282 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:17.666796 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:17.667783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:17.668249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:17.668609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:17.669386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:17.669801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:17.671602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:17.687275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 474/943] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:17.693721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:17.741715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:17.808211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9a6f-30bd-436e-b31d-fc4c084ae860 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:17.845069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:17.845690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:17.845966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:17.846232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:17.854126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:17.855567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:19:17.867931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:17.870048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:17.871433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 470/944] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:17.875308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:17.940777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:17.992833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5f77f-8c97-4898-93ee-0aa312e85cd8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:18.032327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:18.033017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:18.033344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:18.033668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:18.035061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:18.035415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:18.037019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:18.056200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 475/945] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 12 12:19:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:18.062331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:18.171998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57925d1-e2d9-49ba-baa4-7ed928adae62 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:18.173631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:18.209606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:18.210230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:18.210517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:18.210782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:18.222617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:18.224164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:18.239167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:18.240388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:18.241796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:18.241796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:18.241796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:18.241796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 471/946] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:18.246170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:18.361975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b912e9-ea7e-42aa-b86e-003824d6b04c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:18.383376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:18.399115 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:18.399742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:18.400060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:18.400337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:18.400980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:18.401286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:18.402646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:18.413863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 476/947] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:19:18.419717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:18.533562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca4cc-d75b-4ebd-9ba4-c17dbe7983b2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:18.571337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:18.572258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:18.572541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:18.572812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:18.580639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:18.582778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:19:18.596562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:18.597714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:18.598824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 472/948] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:18.601660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:18.709737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d11919-1ee6-49ea-8658-c382112e977c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:18.746513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547d808-f733-468f-84f7-9a4bc0822409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:18.747130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547d808-f733-468f-84f7-9a4bc0822409 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:18.747412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547d808-f733-468f-84f7-9a4bc0822409 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:18.747690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547d808-f733-468f-84f7-9a4bc0822409 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:18.748423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547d808-f733-468f-84f7-9a4bc0822409 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:18.748733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547d808-f733-468f-84f7-9a4bc0822409 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:18.750156 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547d808-f733-468f-84f7-9a4bc0822409 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:18.763351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 477/949] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:18.769552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:18.786471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:18.880211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705116-d2a8-45f4-8b28-48ce42c4c737 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:18.915138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468623c-7a6a-4742-99e0-237acb4572df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:18.915835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468623c-7a6a-4742-99e0-237acb4572df None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:18.916169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468623c-7a6a-4742-99e0-237acb4572df None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:18.916467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468623c-7a6a-4742-99e0-237acb4572df None admin] PATH_INFO: `/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/48cdf9ded77746a793b76d2df4940d63/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:18.918364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468623c-7a6a-4742-99e0-237acb4572df None admin] RBAC: Authorizing `identity:create_grant(project_id=d9643deeb10a4409bf8fc0de3692ba8b, user_id=48cdf9ded77746a793b76d2df4940d63, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:18.919819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468623c-7a6a-4742-99e0-237acb4572df None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:18.932295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 473/950] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Oct 12 12:19:18 2022] PUT /identity/v3/projects/d9643deeb10a4409bf8fc0de3692ba8b/users/48cdf9ded77746a793b76d2df4940d63/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:19:21.082248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c4fa-85a5-4df5-b26e-2f05206259a1 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:21.082863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c4fa-85a5-4df5-b26e-2f05206259a1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:21.082863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c4fa-85a5-4df5-b26e-2f05206259a1 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:21.084199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 478/951] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:19:21.089720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7ffb-d6cd-4878-a63d-770a9b63aef5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:21.090163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7ffb-d6cd-4878-a63d-770a9b63aef5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:21.090255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7ffb-d6cd-4878-a63d-770a9b63aef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:21.109568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-de9b7ffb-d6cd-4878-a63d-770a9b63aef5 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:21.110983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-de9b7ffb-d6cd-4878-a63d-770a9b63aef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:21.181568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 474/952] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:19:21.450159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c4fa-85a5-4df5-b26e-2f05206259a1 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:21.502054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:21.570887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c4fa-85a5-4df5-b26e-2f05206259a1 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:21.606085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:21.606811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:21.607106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:21.607437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:21.618778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:19:21.624107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:21.625198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:21.626114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 479/953] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Oct 12 12:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:21.631472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7ffb-d6cd-4878-a63d-770a9b63aef5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:21.635370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:21.735392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7ffb-d6cd-4878-a63d-770a9b63aef5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:21.777236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:21.777862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:21.778187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:21.778490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:21.779310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:21.779621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:21.781147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:21.790716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 475/954] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Oct 12 12:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:19:21.797031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:21.898327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:21.901294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896521-b2af-45ef-a248-e535731e70ea None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:21.940403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:21.941529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:21.941804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:21.942115 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:21.953062 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:21.954514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:21.971450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:21.972679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:21.973867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:21.973867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:21.973867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:21.973867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 480/955] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:21.978471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:22.052122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:22.088360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a110-191c-4944-ae65-c099c521995d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:22.124680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:22.125319 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:22.125550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:22.125820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:22.126468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:22.126767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:22.128166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:22.140224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 476/956] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:22.146015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:22.254822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c6a70-a5eb-4b61-aee8-23d0ed81e3b3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:22.289567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:22.290213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:22.290492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:22.290764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:22.299368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:22.300932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:19:22.313256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:22.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:22.316501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 481/957] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:22.320856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:22.425473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531fc6-f7ab-45b4-95fa-3ea68411a2f7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:22.452951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:22.463053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:22.463663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:22.463984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:22.464255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:22.464995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:22.465300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:22.466743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:22.486384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 477/958] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Oct 12 12:19:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:22.493158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:22.512104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:22.603975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4e78b-3393-48ad-9824-bf29ed3e8700 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:22.638279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:22.638880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:22.639155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:22.639425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:22.711164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:22.712650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:22.726250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:22.813589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 482/959] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Oct 12 12:19:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:19:22.820287 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:22.916470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1c148-c475-4b48-a323-0e04c89da6ac None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:22.948721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:22.949334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:22.949612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:22.949883 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:22.959664 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:22.961132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:19:22.975494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:22.976677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:19:22.977786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:19:22.977786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:19:22.977786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:22.977786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 478/960] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:22.982332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:23.077251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e4e2-13db-4951-9dca-8c8a6e0172aa None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:23.090535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:23.111470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:23.112094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:23.112913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:23.113186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:23.113816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:23.114116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:23.115468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:23.126136 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 483/961] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Oct 12 12:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:23.131683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:23.165871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:23.229743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fe0f-af97-4091-8311-cfb6ad097445 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:23.267725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:23.268363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:23.269149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:23.269423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:23.275981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:23.277399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:19:23.288878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:23.289922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Oct 12 12:19:23.291034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 479/962] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Oct 12 12:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:23.295742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:23.390356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0c771-62e4-447b-b363-1eac194867ab None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:23.422819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a50066-0219-4cd9-b897-1799c486a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:23.423404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50066-0219-4cd9-b897-1799c486a0dc None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:23.423686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50066-0219-4cd9-b897-1799c486a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:23.423995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50066-0219-4cd9-b897-1799c486a0dc None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:23.424699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a50066-0219-4cd9-b897-1799c486a0dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:23.425008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a50066-0219-4cd9-b897-1799c486a0dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:23.426428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a50066-0219-4cd9-b897-1799c486a0dc None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:23.437777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 484/963] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Oct 12 12:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:23.443528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:23.546025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:23.552461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937ae43-0131-47a5-b11e-827bf9bd162d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:23.584766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d9a69-34ed-41e9-a092-8e13c74fc214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:23.585357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d9a69-34ed-41e9-a092-8e13c74fc214 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:23.585636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d9a69-34ed-41e9-a092-8e13c74fc214 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:23.585906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d9a69-34ed-41e9-a092-8e13c74fc214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:23.586624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d9a69-34ed-41e9-a092-8e13c74fc214 None admin] RBAC: Adding query filter params (role.id=d3153f0d6f0840cea1f6440f44870b0d, scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b, user.id=48cdf9ded77746a793b76d2df4940d63) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:23.586930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d9a69-34ed-41e9-a092-8e13c74fc214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:23.588384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d9a69-34ed-41e9-a092-8e13c74fc214 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:23.594020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 480/964] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Oct 12 12:19:23 2022] GET /identity/v3/role_assignments?user.id=48cdf9ded77746a793b76d2df4940d63&scope.project.id=d9643deeb10a4409bf8fc0de3692ba8b&role.id=d3153f0d6f0840cea1f6440f44870b0d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:25.742756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bec2c-fa57-4deb-9eeb-9a54915d71af None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:25.743284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bec2c-fa57-4deb-9eeb-9a54915d71af None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:25.743284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bec2c-fa57-4deb-9eeb-9a54915d71af None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:25.744644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 485/965] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:19:25.749862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db123-762a-423f-90c7-6a4ada7e63b8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:25.750258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db123-762a-423f-90c7-6a4ada7e63b8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:25.750413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db123-762a-423f-90c7-6a4ada7e63b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:25.768348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-514db123-762a-423f-90c7-6a4ada7e63b8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:25.770045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-514db123-762a-423f-90c7-6a4ada7e63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:25.835583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 481/966] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:26.100783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bec2c-fa57-4deb-9eeb-9a54915d71af None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:26.131123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:26.199729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bec2c-fa57-4deb-9eeb-9a54915d71af None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:26.232925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:26.233540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:26.233822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:26.234097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:26.234675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:26.236062 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:26.245181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:26.246363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:26.247568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 486/967] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:19:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:26.252106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514db123-762a-423f-90c7-6a4ada7e63b8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:26.338231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:26.347342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514db123-762a-423f-90c7-6a4ada7e63b8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:26.380096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5abc-4450-497a-883a-e157f1534161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:26.380624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5abc-4450-497a-883a-e157f1534161 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:26.380902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5abc-4450-497a-883a-e157f1534161 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:26.381171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5abc-4450-497a-883a-e157f1534161 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:26.381784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5abc-4450-497a-883a-e157f1534161 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:26.382082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5abc-4450-497a-883a-e157f1534161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:26.383420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5abc-4450-497a-883a-e157f1534161 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:26.388123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 482/968] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 12 12:19:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:26.393711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:26.485535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:26.492145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9d4e3-b574-4472-b8e0-5724c86870f5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:26.527417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c483f0-0f33-42eb-a3d9-7eed05e28a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:26.528063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c483f0-0f33-42eb-a3d9-7eed05e28a63 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:26.528345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c483f0-0f33-42eb-a3d9-7eed05e28a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:26.528618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c483f0-0f33-42eb-a3d9-7eed05e28a63 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:26.529254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c483f0-0f33-42eb-a3d9-7eed05e28a63 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:26.529551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c483f0-0f33-42eb-a3d9-7eed05e28a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:26.530930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c483f0-0f33-42eb-a3d9-7eed05e28a63 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:26.536108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 487/969] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 12 12:19:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:28.641813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe54f6-6390-41a5-916b-c1ba87090eb2 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:28.642340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe54f6-6390-41a5-916b-c1ba87090eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:28.642340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe54f6-6390-41a5-916b-c1ba87090eb2 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:28.643667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 483/970] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:19:28.648956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b675fc-26d9-4543-993d-0f2ce8cacfbc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:28.649378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b675fc-26d9-4543-993d-0f2ce8cacfbc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:28.649484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b675fc-26d9-4543-993d-0f2ce8cacfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:28.667030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-26b675fc-26d9-4543-993d-0f2ce8cacfbc None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:28.668238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-26b675fc-26d9-4543-993d-0f2ce8cacfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:28.731652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 488/971] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:28.996840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe54f6-6390-41a5-916b-c1ba87090eb2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:29.092523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe54f6-6390-41a5-916b-c1ba87090eb2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:29.125298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10da74-97ad-4f19-b776-2acf92012bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:29.125876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10da74-97ad-4f19-b776-2acf92012bc6 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:29.126155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10da74-97ad-4f19-b776-2acf92012bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:29.126423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10da74-97ad-4f19-b776-2acf92012bc6 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:29.127067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10da74-97ad-4f19-b776-2acf92012bc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:29.128446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10da74-97ad-4f19-b776-2acf92012bc6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:29.142602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 484/972] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Oct 12 12:19:28 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:19:31.284611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb61c-f9fb-4316-81b9-541ea25a531d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:31.285706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb61c-f9fb-4316-81b9-541ea25a531d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:31.285706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb61c-f9fb-4316-81b9-541ea25a531d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:31.287030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 489/973] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:19:31.292252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddd9ec-94af-46ad-ab6e-25c7ebd80c74 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:31.292683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddd9ec-94af-46ad-ab6e-25c7ebd80c74 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:31.292782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddd9ec-94af-46ad-ab6e-25c7ebd80c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:31.311006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-80ddd9ec-94af-46ad-ab6e-25c7ebd80c74 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:31.312220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-80ddd9ec-94af-46ad-ab6e-25c7ebd80c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:31.321062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:31.381775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 485/974] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:31.659106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb61c-f9fb-4316-81b9-541ea25a531d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:31.746713 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:31.757221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb61c-f9fb-4316-81b9-541ea25a531d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:31.790699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:31.791317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:31.791596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:31.791895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:31.792471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:31.793830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:31.802281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:31.803546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:31.804724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 490/975] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:19:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:31.809434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddd9ec-94af-46ad-ab6e-25c7ebd80c74 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:31.905645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddd9ec-94af-46ad-ab6e-25c7ebd80c74 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:31.937249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:31.937783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:31.938061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:31.938331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:31.938954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:31.939256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:31.940635 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:31.946006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 486/976] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 12 12:19:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:31.951843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:32.049386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dff5de-110e-49ac-9f33-c2a08feb716f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:32.082414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9101197-bdd2-444d-8083-c2401bcaf19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:32.083003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101197-bdd2-444d-8083-c2401bcaf19f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:32.083282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101197-bdd2-444d-8083-c2401bcaf19f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:32.083554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101197-bdd2-444d-8083-c2401bcaf19f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:32.084273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9101197-bdd2-444d-8083-c2401bcaf19f None admin] RBAC: Adding query filter params (interface=public, service_id=8e251be687db4471bb42c6bb4df3d044, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:32.084581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9101197-bdd2-444d-8083-c2401bcaf19f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:32.085931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9101197-bdd2-444d-8083-c2401bcaf19f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:32.091020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 491/977] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Oct 12 12:19:31 2022] GET /identity/v3/endpoints?service_id=8e251be687db4471bb42c6bb4df3d044&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:32.096388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:32.099999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:32.190424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b931b-08d0-4ed0-9403-d2a640308f77 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:32.223321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f4881-8092-4e96-aa72-989fa09f4de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:32.223943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4881-8092-4e96-aa72-989fa09f4de7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:32.224224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4881-8092-4e96-aa72-989fa09f4de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:32.224494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4881-8092-4e96-aa72-989fa09f4de7 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:32.225086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f4881-8092-4e96-aa72-989fa09f4de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:32.226430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f4881-8092-4e96-aa72-989fa09f4de7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:32.232881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 487/978] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Oct 12 12:19:32 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:19:34.343356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3d7b-83f0-4a6f-8166-bf065a95997a None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:34.343955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3d7b-83f0-4a6f-8166-bf065a95997a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:34.344054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3d7b-83f0-4a6f-8166-bf065a95997a None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:34.345387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 492/979] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:19:34.350521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15b945-849f-49e0-94b8-4772232d28bf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:34.350902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15b945-849f-49e0-94b8-4772232d28bf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:34.351073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15b945-849f-49e0-94b8-4772232d28bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:34.368703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ac15b945-849f-49e0-94b8-4772232d28bf None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:19:34.369872 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ac15b945-849f-49e0-94b8-4772232d28bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:19:34.428617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:34.434356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 488/980] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:19:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:19:34.716750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb3d7b-83f0-4a6f-8166-bf065a95997a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:34.735450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:34.814719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb3d7b-83f0-4a6f-8166-bf065a95997a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:34.847140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:34.848308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:34.848587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:34.848855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:34.849428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:34.850782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:19:34.859199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:19:34.860380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 12 12:19:34.861406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 493/981] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Oct 12 12:19:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:19:34.866933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15b945-849f-49e0-94b8-4772232d28bf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:34.960316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15b945-849f-49e0-94b8-4772232d28bf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:34.993294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395961a3-4232-4e2d-bca6-d544cd328671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:34.993830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395961a3-4232-4e2d-bca6-d544cd328671 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:34.994113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395961a3-4232-4e2d-bca6-d544cd328671 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:34.994385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395961a3-4232-4e2d-bca6-d544cd328671 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:34.995008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395961a3-4232-4e2d-bca6-d544cd328671 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:19:34.995311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395961a3-4232-4e2d-bca6-d544cd328671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:34.996694 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395961a3-4232-4e2d-bca6-d544cd328671 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:35.001561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 489/982] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Oct 12 12:19:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:19:35.007081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:19:35.085831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:35.103871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b697feb-ebe5-4679-80fa-dd1aed1e37a0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:19:35.135823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fb066-3630-4259-97fa-12c90f01a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:19:35.136424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fb066-3630-4259-97fa-12c90f01a1e2 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:19:35.136702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fb066-3630-4259-97fa-12c90f01a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:19:35.136974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fb066-3630-4259-97fa-12c90f01a1e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:19:35.137636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fb066-3630-4259-97fa-12c90f01a1e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:19:35.138983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fb066-3630-4259-97fa-12c90f01a1e2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:19:35.156854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 494/983] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:19:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:19:44.998731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=69 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:19:45.152867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:38.035390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9055-2b60-4bd1-9442-27226d43200d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:38.035897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9055-2b60-4bd1-9442-27226d43200d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:38.036109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9055-2b60-4bd1-9442-27226d43200d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:38.037665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 490/984] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:38.042932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b222-bee3-455e-9d8f-6c57e47c63a6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:38.043376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b222-bee3-455e-9d8f-6c57e47c63a6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:38.043470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b222-bee3-455e-9d8f-6c57e47c63a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:38.141257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d8a1b222-bee3-455e-9d8f-6c57e47c63a6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:38.142533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d8a1b222-bee3-455e-9d8f-6c57e47c63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:38.292639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 495/985] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:38.577202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a59686-dfda-4be0-9358-d124ed37b8f5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:38.577576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a59686-dfda-4be0-9358-d124ed37b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:38.577946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a59686-dfda-4be0-9358-d124ed37b8f5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:38.579519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 491/986] 10.222.0.45 () {54 vars in 964 bytes} [Wed Oct 12 12:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:38.586644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ff5d5-fef3-4839-820d-cbedd568307f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:38.586935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ff5d5-fef3-4839-820d-cbedd568307f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:38.587206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ff5d5-fef3-4839-820d-cbedd568307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:38.664842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-422ff5d5-fef3-4839-820d-cbedd568307f None None] MFA Rules not processed for user `319b5538054c49d19ecc0b9c9cfc5b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:38.666045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-422ff5d5-fef3-4839-820d-cbedd568307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:38.687416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:38.752990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 496/987] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Oct 12 12:20:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:38.763313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a59686-dfda-4be0-9358-d124ed37b8f5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:20:38.765309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-29a59686-dfda-4be0-9358-d124ed37b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:38.890414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a59686-dfda-4be0-9358-d124ed37b8f5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:20:38.975111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabb2cc-6814-4e7b-9393-d27f164c238c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:20:38.975722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabb2cc-6814-4e7b-9393-d27f164c238c service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:38.976049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabb2cc-6814-4e7b-9393-d27f164c238c service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:38.976327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabb2cc-6814-4e7b-9393-d27f164c238c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:38.977930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dcabb2cc-6814-4e7b-9393-d27f164c238c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:39.035518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:39.096609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabb2cc-6814-4e7b-9393-d27f164c238c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:20:39.098057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabb2cc-6814-4e7b-9393-d27f164c238c service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:20:39.121294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 492/988] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:20:41.578499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248d487-a4c7-4b12-bad5-4e38a90a248a None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:41.579061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248d487-a4c7-4b12-bad5-4e38a90a248a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:41.579061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248d487-a4c7-4b12-bad5-4e38a90a248a None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:41.580671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 497/989] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:41.585682 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6d96-b992-47e3-ac3c-10300830c47c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:41.586375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6d96-b992-47e3-ac3c-10300830c47c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:41.586524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6d96-b992-47e3-ac3c-10300830c47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:41.669433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-568d6d96-b992-47e3-ac3c-10300830c47c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:41.670708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-568d6d96-b992-47e3-ac3c-10300830c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:41.767025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 493/990] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:42.048518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248d487-a4c7-4b12-bad5-4e38a90a248a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:20:42.050125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a248d487-a4c7-4b12-bad5-4e38a90a248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:42.152942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248d487-a4c7-4b12-bad5-4e38a90a248a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:20:42.224214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:42.226697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199674a7-2aa8-4e21-a349-f8a0a069711b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:20:42.227343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199674a7-2aa8-4e21-a349-f8a0a069711b service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:42.227921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199674a7-2aa8-4e21-a349-f8a0a069711b service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:42.228419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199674a7-2aa8-4e21-a349-f8a0a069711b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:42.230235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-199674a7-2aa8-4e21-a349-f8a0a069711b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:42.338668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199674a7-2aa8-4e21-a349-f8a0a069711b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:20:42.340261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199674a7-2aa8-4e21-a349-f8a0a069711b service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:20:42.358446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 498/991] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:20:44.788597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79070-eeac-414a-a046-ba3ce0b54c56 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:44.789070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79070-eeac-414a-a046-ba3ce0b54c56 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:44.789177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79070-eeac-414a-a046-ba3ce0b54c56 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:44.790462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 494/992] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:44.795708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809e81-544d-4902-8f21-1dbcac57019a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:44.796173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809e81-544d-4902-8f21-1dbcac57019a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:44.796290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809e81-544d-4902-8f21-1dbcac57019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:44.860282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-20809e81-544d-4902-8f21-1dbcac57019a None None] MFA Rules not processed for user `d8f8c179d1464c7c9b321899a46d8739`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:44.861478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-20809e81-544d-4902-8f21-1dbcac57019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:44.911904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:44.955226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 499/993] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:20:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:45.236991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac79070-eeac-414a-a046-ba3ce0b54c56 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:20:45.238523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2ac79070-eeac-414a-a046-ba3ce0b54c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:45.248189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:45.340116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac79070-eeac-414a-a046-ba3ce0b54c56 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:20:45.413109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6221a0-65ac-4d08-a8ec-203f409674f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:20:45.413700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6221a0-65ac-4d08-a8ec-203f409674f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:45.413975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6221a0-65ac-4d08-a8ec-203f409674f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:45.414238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6221a0-65ac-4d08-a8ec-203f409674f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:45.415792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-af6221a0-65ac-4d08-a8ec-203f409674f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:45.476314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:45.523886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6221a0-65ac-4d08-a8ec-203f409674f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:20:45.525268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6221a0-65ac-4d08-a8ec-203f409674f8 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:20:45.542998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 495/994] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:20:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:20:48.207544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d236-68bf-4eb8-89c4-ebea5f1602c2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:48.208107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d236-68bf-4eb8-89c4-ebea5f1602c2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:48.208107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d236-68bf-4eb8-89c4-ebea5f1602c2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:48.210007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 500/995] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:48.215570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6cd92-c890-45dc-ba26-e5b7ee5b3f28 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:48.216022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6cd92-c890-45dc-ba26-e5b7ee5b3f28 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:48.216178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6cd92-c890-45dc-ba26-e5b7ee5b3f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:48.281535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-86d6cd92-c890-45dc-ba26-e5b7ee5b3f28 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:48.282715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-86d6cd92-c890-45dc-ba26-e5b7ee5b3f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:48.377315 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 496/996] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:48.660149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5d236-68bf-4eb8-89c4-ebea5f1602c2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:20:48.661771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5de5d236-68bf-4eb8-89c4-ebea5f1602c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:48.762165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5d236-68bf-4eb8-89c4-ebea5f1602c2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:20:48.833544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce35fd-ea26-429c-a5b3-757e21b8ed0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:20:48.834144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce35fd-ea26-429c-a5b3-757e21b8ed0f service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:48.834425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce35fd-ea26-429c-a5b3-757e21b8ed0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:48.834697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce35fd-ea26-429c-a5b3-757e21b8ed0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:48.836387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f7ce35fd-ea26-429c-a5b3-757e21b8ed0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:48.843333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:48.943760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce35fd-ea26-429c-a5b3-757e21b8ed0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:20:48.945165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce35fd-ea26-429c-a5b3-757e21b8ed0f service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:20:48.963419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 501/997] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:20:51.743122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352194-0d3b-4692-bfc3-1c99ea02efb9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:51.743647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352194-0d3b-4692-bfc3-1c99ea02efb9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:51.743647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352194-0d3b-4692-bfc3-1c99ea02efb9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:51.744930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 497/998] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:51.750284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b57a9-741b-4d5c-a1d0-8a9d855da631 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:51.750691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b57a9-741b-4d5c-a1d0-8a9d855da631 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:51.750859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b57a9-741b-4d5c-a1d0-8a9d855da631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:51.824620 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8f0b57a9-741b-4d5c-a1d0-8a9d855da631 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:51.825866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8f0b57a9-741b-4d5c-a1d0-8a9d855da631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:51.888114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:51.929401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 502/999] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:52.209317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352194-0d3b-4692-bfc3-1c99ea02efb9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:20:52.210888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-15352194-0d3b-4692-bfc3-1c99ea02efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:52.230417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:52.314641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352194-0d3b-4692-bfc3-1c99ea02efb9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:20:52.387716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3af91-1781-45aa-b461-130fd6ec9ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:20:52.388346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3af91-1781-45aa-b461-130fd6ec9ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:52.388629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3af91-1781-45aa-b461-130fd6ec9ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:52.388898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3af91-1781-45aa-b461-130fd6ec9ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:52.390474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-00a3af91-1781-45aa-b461-130fd6ec9ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:52.463611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:52.503079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3af91-1781-45aa-b461-130fd6ec9ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:20:52.504560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3af91-1781-45aa-b461-130fd6ec9ae5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:20:52.522171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 498/1000] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:20:54.704858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f72b8f-9d95-4fa8-ac4d-b672a193b3b6 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:54.705406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f72b8f-9d95-4fa8-ac4d-b672a193b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:54.705406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f72b8f-9d95-4fa8-ac4d-b672a193b3b6 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:54.706864 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 503/1001] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:54.712295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef643c-2719-448b-ac09-bf61cc5005c1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:54.712680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef643c-2719-448b-ac09-bf61cc5005c1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:54.712845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef643c-2719-448b-ac09-bf61cc5005c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:54.778720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-04ef643c-2719-448b-ac09-bf61cc5005c1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:54.779952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-04ef643c-2719-448b-ac09-bf61cc5005c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:54.886014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 499/1002] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:55.169000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f72b8f-9d95-4fa8-ac4d-b672a193b3b6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:20:55.170562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c4f72b8f-9d95-4fa8-ac4d-b672a193b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:55.280406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f72b8f-9d95-4fa8-ac4d-b672a193b3b6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:20:55.361448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4202a1-24f4-479c-8c2d-d34417a61904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:20:55.362059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4202a1-24f4-479c-8c2d-d34417a61904 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:55.362335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4202a1-24f4-479c-8c2d-d34417a61904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:55.362610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4202a1-24f4-479c-8c2d-d34417a61904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:55.364244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-be4202a1-24f4-479c-8c2d-d34417a61904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:55.382140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:55.494436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4202a1-24f4-479c-8c2d-d34417a61904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:20:55.495900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4202a1-24f4-479c-8c2d-d34417a61904 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:20:55.514524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 504/1003] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:20:57.715022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65caa2-b013-481f-92a9-11cc16dd3e74 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:57.715608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65caa2-b013-481f-92a9-11cc16dd3e74 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:57.715608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65caa2-b013-481f-92a9-11cc16dd3e74 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:57.716981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 500/1004] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:20:57.726433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df44d5-a76a-4eee-b3e4-0c02af774a2f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:57.726852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df44d5-a76a-4eee-b3e4-0c02af774a2f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:57.726969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df44d5-a76a-4eee-b3e4-0c02af774a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:57.792099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a9df44d5-a76a-4eee-b3e4-0c02af774a2f None None] MFA Rules not processed for user `d8f8c179d1464c7c9b321899a46d8739`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:20:57.793304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a9df44d5-a76a-4eee-b3e4-0c02af774a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:57.858113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:57.890298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 505/1005] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:20:58.174839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65caa2-b013-481f-92a9-11cc16dd3e74 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:20:58.176448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6e65caa2-b013-481f-92a9-11cc16dd3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:58.210114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:58.286388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65caa2-b013-481f-92a9-11cc16dd3e74 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:20:58.360964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad46f89-590d-4b62-a7a9-6e9e33d1d3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:20:58.361571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad46f89-590d-4b62-a7a9-6e9e33d1d3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:20:58.361853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad46f89-590d-4b62-a7a9-6e9e33d1d3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:20:58.362127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad46f89-590d-4b62-a7a9-6e9e33d1d3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:20:58.363701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3ad46f89-590d-4b62-a7a9-6e9e33d1d3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:20:58.442343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:20:58.474700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad46f89-590d-4b62-a7a9-6e9e33d1d3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:20:58.476672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad46f89-590d-4b62-a7a9-6e9e33d1d3a5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:20:58.494902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 501/1006] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:20:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:00.831302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa686e-3294-4e1b-af9b-a92c962a822e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:00.831825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa686e-3294-4e1b-af9b-a92c962a822e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:00.831921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa686e-3294-4e1b-af9b-a92c962a822e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:00.833310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 506/1007] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:00.838818 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c4e-94a4-4fd0-9004-93e9f4fd2054 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:00.839262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c4e-94a4-4fd0-9004-93e9f4fd2054 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:00.839371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c4e-94a4-4fd0-9004-93e9f4fd2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:00.903618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-22304c4e-94a4-4fd0-9004-93e9f4fd2054 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:00.904840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-22304c4e-94a4-4fd0-9004-93e9f4fd2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:00.998514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 502/1008] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:01.275250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa686e-3294-4e1b-af9b-a92c962a822e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:01.276787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-22aa686e-3294-4e1b-af9b-a92c962a822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:01.376439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa686e-3294-4e1b-af9b-a92c962a822e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:01.448162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a47be-566f-43b3-bce0-6f3db688b6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:01.448758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a47be-566f-43b3-bce0-6f3db688b6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:01.449039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a47be-566f-43b3-bce0-6f3db688b6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:01.449312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a47be-566f-43b3-bce0-6f3db688b6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:01.450886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5a8a47be-566f-43b3-bce0-6f3db688b6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:01.478381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:01.558575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a47be-566f-43b3-bce0-6f3db688b6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:01.559949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a47be-566f-43b3-bce0-6f3db688b6c5 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:01.578039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 507/1009] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:03.769371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2391-a574-4ac5-b6e3-d47e4b49a95c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:03.769918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2391-a574-4ac5-b6e3-d47e4b49a95c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:03.769918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2391-a574-4ac5-b6e3-d47e4b49a95c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:03.771210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 503/1010] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:03.776822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876bb5-cb9d-4785-8796-97d90d57b4e8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:03.777222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876bb5-cb9d-4785-8796-97d90d57b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:03.777377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876bb5-cb9d-4785-8796-97d90d57b4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:03.841213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c9876bb5-cb9d-4785-8796-97d90d57b4e8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:03.842437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c9876bb5-cb9d-4785-8796-97d90d57b4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:03.914582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:03.936798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 508/1011] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:04.218005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2391-a574-4ac5-b6e3-d47e4b49a95c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:04.219537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-371b2391-a574-4ac5-b6e3-d47e4b49a95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:04.259168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:04.320870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2391-a574-4ac5-b6e3-d47e4b49a95c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:04.392343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d624c9a-c55d-4cb3-bfe7-59c726e6e15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:04.392954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624c9a-c55d-4cb3-bfe7-59c726e6e15e service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:04.393235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624c9a-c55d-4cb3-bfe7-59c726e6e15e service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:04.393504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624c9a-c55d-4cb3-bfe7-59c726e6e15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:04.395073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3d624c9a-c55d-4cb3-bfe7-59c726e6e15e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:04.478564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:04.506599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624c9a-c55d-4cb3-bfe7-59c726e6e15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:04.508577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624c9a-c55d-4cb3-bfe7-59c726e6e15e service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:04.527452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 504/1012] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:06.938989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7403b-b2e8-46ea-b719-a68c803b7813 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:06.939551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7403b-b2e8-46ea-b719-a68c803b7813 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:06.939678 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7403b-b2e8-46ea-b719-a68c803b7813 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:06.941101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 509/1013] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:06.946166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fa22-63b6-4197-a6a0-50e47e138f33 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:06.946569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fa22-63b6-4197-a6a0-50e47e138f33 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:06.946707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fa22-63b6-4197-a6a0-50e47e138f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:07.013911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-38d4fa22-63b6-4197-a6a0-50e47e138f33 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:07.015122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-38d4fa22-63b6-4197-a6a0-50e47e138f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:07.109205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 505/1014] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:21:07.391868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7403b-b2e8-46ea-b719-a68c803b7813 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:07.393389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5fa7403b-b2e8-46ea-b719-a68c803b7813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:07.500047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7403b-b2e8-46ea-b719-a68c803b7813 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:07.573628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa46f09-4a8c-45b0-95c6-d775e21665f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:07.574223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa46f09-4a8c-45b0-95c6-d775e21665f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:07.574502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa46f09-4a8c-45b0-95c6-d775e21665f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:07.574773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa46f09-4a8c-45b0-95c6-d775e21665f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:07.576385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4aa46f09-4a8c-45b0-95c6-d775e21665f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:07.610832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:07.683668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa46f09-4a8c-45b0-95c6-d775e21665f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:07.685071 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa46f09-4a8c-45b0-95c6-d775e21665f8 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:07.702952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 510/1015] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:11.723448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1c8d3-474b-4b1b-a62d-c6f3f03b13bc None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:11.724077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1c8d3-474b-4b1b-a62d-c6f3f03b13bc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:11.724077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1c8d3-474b-4b1b-a62d-c6f3f03b13bc None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:11.725284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 506/1016] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:11.730603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b424-77ff-4723-a3ca-738d6c58ab69 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:11.731003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b424-77ff-4723-a3ca-738d6c58ab69 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:11.731289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b424-77ff-4723-a3ca-738d6c58ab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:11.799449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2b02b424-77ff-4723-a3ca-738d6c58ab69 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:11.800687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2b02b424-77ff-4723-a3ca-738d6c58ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:11.886194 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:11.898104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 511/1017] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:12.180424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1c8d3-474b-4b1b-a62d-c6f3f03b13bc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:12.181984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-efd1c8d3-474b-4b1b-a62d-c6f3f03b13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:12.231291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:12.285438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1c8d3-474b-4b1b-a62d-c6f3f03b13bc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:12.359681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939791d-89b8-4115-83ee-834ca2438ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:12.360323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939791d-89b8-4115-83ee-834ca2438ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:12.360598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939791d-89b8-4115-83ee-834ca2438ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:12.360869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939791d-89b8-4115-83ee-834ca2438ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:12.362457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5939791d-89b8-4115-83ee-834ca2438ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:12.454440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:12.471626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939791d-89b8-4115-83ee-834ca2438ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:12.473095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939791d-89b8-4115-83ee-834ca2438ac7 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:12.493216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 507/1018] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:15.292777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289868b6-b2f9-4165-9144-437e9691d546 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:15.293311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289868b6-b2f9-4165-9144-437e9691d546 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:15.293311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289868b6-b2f9-4165-9144-437e9691d546 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:15.294669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 512/1019] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:15.299764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c41e5-1f3a-43be-b92c-c35e86e25591 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:15.300225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c41e5-1f3a-43be-b92c-c35e86e25591 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:15.300505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c41e5-1f3a-43be-b92c-c35e86e25591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:15.366844 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f40c41e5-1f3a-43be-b92c-c35e86e25591 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:15.368099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f40c41e5-1f3a-43be-b92c-c35e86e25591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:15.465784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 508/1020] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:15.758812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289868b6-b2f9-4165-9144-437e9691d546 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:15.760367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-289868b6-b2f9-4165-9144-437e9691d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:15.877201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289868b6-b2f9-4165-9144-437e9691d546 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:15.951019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58a78-ee0c-4090-8fba-62ebbd171db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:15.951536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58a78-ee0c-4090-8fba-62ebbd171db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:15.951844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58a78-ee0c-4090-8fba-62ebbd171db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:15.952118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58a78-ee0c-4090-8fba-62ebbd171db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:15.953695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e2d58a78-ee0c-4090-8fba-62ebbd171db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:15.997585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:16.066994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d58a78-ee0c-4090-8fba-62ebbd171db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:16.068490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d58a78-ee0c-4090-8fba-62ebbd171db0 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:16.087733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 513/1021] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:20.260505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246bc1-6f18-486c-93bf-e08a2e939fc0 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:20.260993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246bc1-6f18-486c-93bf-e08a2e939fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:20.261097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246bc1-6f18-486c-93bf-e08a2e939fc0 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:20.262405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 509/1022] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:20.267781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e857-4fc8-4c45-b05b-a6b33eca6f6c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:20.268223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e857-4fc8-4c45-b05b-a6b33eca6f6c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:20.268405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e857-4fc8-4c45-b05b-a6b33eca6f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:20.333728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2d51e857-4fc8-4c45-b05b-a6b33eca6f6c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:20.334877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d51e857-4fc8-4c45-b05b-a6b33eca6f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:20.427236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:20.430180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 514/1023] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:20.711734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66246bc1-6f18-486c-93bf-e08a2e939fc0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:20.713297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-66246bc1-6f18-486c-93bf-e08a2e939fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:20.770521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:20.816956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66246bc1-6f18-486c-93bf-e08a2e939fc0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:20.890147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef153f4-7c3e-4c26-ad08-a27dfc22e531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:20.890750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef153f4-7c3e-4c26-ad08-a27dfc22e531 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:20.891031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef153f4-7c3e-4c26-ad08-a27dfc22e531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:20.891303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef153f4-7c3e-4c26-ad08-a27dfc22e531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:20.893093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1ef153f4-7c3e-4c26-ad08-a27dfc22e531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:20.996382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:21.000030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef153f4-7c3e-4c26-ad08-a27dfc22e531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:21.001947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef153f4-7c3e-4c26-ad08-a27dfc22e531 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:21.020039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 510/1024] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:25.896231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552438e-0c28-40e3-9ed3-afe4d19e579e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:25.896670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552438e-0c28-40e3-9ed3-afe4d19e579e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:25.896814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552438e-0c28-40e3-9ed3-afe4d19e579e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:25.898376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 515/1025] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:25.903575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e1e4-d858-41f0-86aa-fcabfb816967 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:25.904882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e1e4-d858-41f0-86aa-fcabfb816967 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:25.908567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e1e4-d858-41f0-86aa-fcabfb816967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:26.012569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cf44e1e4-d858-41f0-86aa-fcabfb816967 None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:26.014088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cf44e1e4-d858-41f0-86aa-fcabfb816967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:26.163848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 511/1026] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:30.204805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1309b97-6c95-4267-ac09-d581699e0f41 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:30.205355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1309b97-6c95-4267-ac09-d581699e0f41 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:30.205355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1309b97-6c95-4267-ac09-d581699e0f41 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:30.206866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 516/1027] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:30.212300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4288d-6ca9-4aaf-8154-a2226285b3ca None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:30.212731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4288d-6ca9-4aaf-8154-a2226285b3ca None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:30.212837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4288d-6ca9-4aaf-8154-a2226285b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:30.269047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:30.293763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1ac4288d-6ca9-4aaf-8154-a2226285b3ca None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:30.295042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1ac4288d-6ca9-4aaf-8154-a2226285b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:30.408062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 512/1028] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:31.878103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ab45-9db9-4e17-8fa0-aceef7fd39d9 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:31.878614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ab45-9db9-4e17-8fa0-aceef7fd39d9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:31.878725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ab45-9db9-4e17-8fa0-aceef7fd39d9 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:31.880024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 517/1029] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:31.885928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d533b2-1db2-4fab-bf19-d70058c8d8bb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:31.886462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d533b2-1db2-4fab-bf19-d70058c8d8bb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:31.886462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d533b2-1db2-4fab-bf19-d70058c8d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:31.962679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e1d533b2-1db2-4fab-bf19-d70058c8d8bb None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:31.963901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e1d533b2-1db2-4fab-bf19-d70058c8d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:32.004848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:32.069937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 513/1030] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:35.595638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5531ce-7188-42db-a289-bef2a8fddc5b None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:35.596287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5531ce-7188-42db-a289-bef2a8fddc5b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:35.596287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5531ce-7188-42db-a289-bef2a8fddc5b None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:35.597571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 518/1031] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:35.603723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8a98-a191-423b-90f3-80de2b92c7a1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:35.604204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8a98-a191-423b-90f3-80de2b92c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:35.604292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8a98-a191-423b-90f3-80de2b92c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:35.673561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e31a8a98-a191-423b-90f3-80de2b92c7a1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:35.674693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e31a8a98-a191-423b-90f3-80de2b92c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:35.781839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 514/1032] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:36.079540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db391-e04c-432e-abc8-935c44ab6e3c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:36.079765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db391-e04c-432e-abc8-935c44ab6e3c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:36.080105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40db391-e04c-432e-abc8-935c44ab6e3c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:36.081395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 519/1033] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 12 12:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:36.089822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538307-15c8-4572-a525-ef521dc5f207 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:36.091271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538307-15c8-4572-a525-ef521dc5f207 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:36.092222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538307-15c8-4572-a525-ef521dc5f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:36.112750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:36.177050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9f538307-15c8-4572-a525-ef521dc5f207 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:36.178225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f538307-15c8-4572-a525-ef521dc5f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:36.304227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 515/1034] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 12 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:36.312734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db391-e04c-432e-abc8-935c44ab6e3c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:36.314173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e40db391-e04c-432e-abc8-935c44ab6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:36.476068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40db391-e04c-432e-abc8-935c44ab6e3c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:36.553603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:36.595464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c0f5d-99e7-4ed4-bdb9-0c70d92b239c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:36.596099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c0f5d-99e7-4ed4-bdb9-0c70d92b239c service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:36.596661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c0f5d-99e7-4ed4-bdb9-0c70d92b239c service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:36.596661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c0f5d-99e7-4ed4-bdb9-0c70d92b239c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:36.598182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-934c0f5d-99e7-4ed4-bdb9-0c70d92b239c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:36.697622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c0f5d-99e7-4ed4-bdb9-0c70d92b239c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:36.699212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c0f5d-99e7-4ed4-bdb9-0c70d92b239c service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:36.718886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 520/1035] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:39.104102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6296e4-af5b-4cde-8e6d-668f5a12ddf8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:39.104102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6296e4-af5b-4cde-8e6d-668f5a12ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:39.105126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6296e4-af5b-4cde-8e6d-668f5a12ddf8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:39.110789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36e35-da59-40a2-b78b-836ef3146117 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:39.111416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36e35-da59-40a2-b78b-836ef3146117 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:39.111416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36e35-da59-40a2-b78b-836ef3146117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:39.115569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 516/1036] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:39.178527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d5a36e35-da59-40a2-b78b-836ef3146117 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:39.179705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d5a36e35-da59-40a2-b78b-836ef3146117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:39.220093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:39.293880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 521/1037] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:21:39.581980 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6296e4-af5b-4cde-8e6d-668f5a12ddf8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:39.583488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-db6296e4-af5b-4cde-8e6d-668f5a12ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:39.664027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:39.776808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6296e4-af5b-4cde-8e6d-668f5a12ddf8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:39.922790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b758f61-f558-47cb-b57a-833398426181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:39.923403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758f61-f558-47cb-b57a-833398426181 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:39.923683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758f61-f558-47cb-b57a-833398426181 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:39.923994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758f61-f558-47cb-b57a-833398426181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:39.925606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9b758f61-f558-47cb-b57a-833398426181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:39.949298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:40.019963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b758f61-f558-47cb-b57a-833398426181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:40.021577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b758f61-f558-47cb-b57a-833398426181 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:40.039665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 517/1038] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:42.497305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3393-5147-4a4d-badc-4403cb86766f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:42.497829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3393-5147-4a4d-badc-4403cb86766f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:42.497829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f3393-5147-4a4d-badc-4403cb86766f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:42.499332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 522/1039] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:42.504396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d485a1-9331-4cb5-ac41-54ad411206ce None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:42.504852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d485a1-9331-4cb5-ac41-54ad411206ce None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:42.504935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d485a1-9331-4cb5-ac41-54ad411206ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:42.573972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-17d485a1-9331-4cb5-ac41-54ad411206ce None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:42.575259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-17d485a1-9331-4cb5-ac41-54ad411206ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:42.677043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:42.684116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 518/1040] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:42.972568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730a3b-91c6-4aab-aace-11a9c2707202 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:42.972975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730a3b-91c6-4aab-aace-11a9c2707202 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:42.973384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730a3b-91c6-4aab-aace-11a9c2707202 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:42.974975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 523/1041] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 12 12:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:42.980791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2f2b-5e5e-417e-a31f-a6f9c6fdaae0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:42.981185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2f2b-5e5e-417e-a31f-a6f9c6fdaae0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:42.981572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2f2b-5e5e-417e-a31f-a6f9c6fdaae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:43.063038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c7ee2f2b-5e5e-417e-a31f-a6f9c6fdaae0 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:43.064419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7ee2f2b-5e5e-417e-a31f-a6f9c6fdaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:43.185739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 519/1042] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 12 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:43.193650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00730a3b-91c6-4aab-aace-11a9c2707202 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:43.195290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-00730a3b-91c6-4aab-aace-11a9c2707202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:43.352411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00730a3b-91c6-4aab-aace-11a9c2707202 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:43.373724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:43.477204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1df05e-feb9-4c05-8a41-7c2c3b5c1cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:43.477890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df05e-feb9-4c05-8a41-7c2c3b5c1cb4 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:43.478282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df05e-feb9-4c05-8a41-7c2c3b5c1cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:43.478623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1df05e-feb9-4c05-8a41-7c2c3b5c1cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:43.480320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7f1df05e-feb9-4c05-8a41-7c2c3b5c1cb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:43.579409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1df05e-feb9-4c05-8a41-7c2c3b5c1cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:43.581861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1df05e-feb9-4c05-8a41-7c2c3b5c1cb4 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:43.605506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 524/1043] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:43.694525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322dec0-e1d3-4ba2-8110-6a10e0ade7be None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:43.695071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322dec0-e1d3-4ba2-8110-6a10e0ade7be None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:43.695229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322dec0-e1d3-4ba2-8110-6a10e0ade7be None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:43.696860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 520/1044] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:43.703933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43235-2cfe-44bc-bc9f-54520c9b572a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:43.704289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43235-2cfe-44bc-bc9f-54520c9b572a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:43.704533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba43235-2cfe-44bc-bc9f-54520c9b572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:43.742021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:43.791938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8ba43235-2cfe-44bc-bc9f-54520c9b572a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:43.793346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8ba43235-2cfe-44bc-bc9f-54520c9b572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:43.916318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 525/1045] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:21:44.209854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c918-6dfa-4a22-ba76-41bfa50a1c1e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:44.210226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c918-6dfa-4a22-ba76-41bfa50a1c1e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:44.210614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c918-6dfa-4a22-ba76-41bfa50a1c1e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:44.212099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 521/1046] 10.222.0.45 () {54 vars in 963 bytes} [Wed Oct 12 12:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:44.217402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fe7b0-42dd-4d15-a9f8-c687f5dd173b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:44.217700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fe7b0-42dd-4d15-a9f8-c687f5dd173b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:44.217984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fe7b0-42dd-4d15-a9f8-c687f5dd173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:44.301359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-be2fe7b0-42dd-4d15-a9f8-c687f5dd173b None None] MFA Rules not processed for user `ce79e1215c0345a59146c8bf6fe26cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:44.301359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-be2fe7b0-42dd-4d15-a9f8-c687f5dd173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:44.351304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:44.386548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 526/1047] 10.222.0.45 () {58 vars in 1060 bytes} [Wed Oct 12 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:44.391697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c918-6dfa-4a22-ba76-41bfa50a1c1e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:44.393386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3533c918-6dfa-4a22-ba76-41bfa50a1c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:44.449132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:44.508890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c918-6dfa-4a22-ba76-41bfa50a1c1e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:44.608462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d36ae-2cb5-4742-920d-fbea8e5f920c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:44.609513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d36ae-2cb5-4742-920d-fbea8e5f920c service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:44.610052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d36ae-2cb5-4742-920d-fbea8e5f920c service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:44.610439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d36ae-2cb5-4742-920d-fbea8e5f920c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:44.612404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dd3d36ae-2cb5-4742-920d-fbea8e5f920c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:44.721498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:44.737066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d36ae-2cb5-4742-920d-fbea8e5f920c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:44.738442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d36ae-2cb5-4742-920d-fbea8e5f920c service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:44.764485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 522/1048] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:45.833626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e652-5e67-4e45-b576-8f572e0ec4c1 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:45.834177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e652-5e67-4e45-b576-8f572e0ec4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:45.834177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e652-5e67-4e45-b576-8f572e0ec4c1 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:45.835536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 527/1049] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:45.840826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bde5a-545a-46f0-b138-c437567cd553 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:45.841461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bde5a-545a-46f0-b138-c437567cd553 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:45.841637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bde5a-545a-46f0-b138-c437567cd553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:45.908606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2b6bde5a-545a-46f0-b138-c437567cd553 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:45.909809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2b6bde5a-545a-46f0-b138-c437567cd553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:46.008858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 523/1050] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:46.306049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e652-5e67-4e45-b576-8f572e0ec4c1 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:46.308175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6979e652-5e67-4e45-b576-8f572e0ec4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:46.468609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e652-5e67-4e45-b576-8f572e0ec4c1 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:46.522282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:46.588249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496ddcc-0c67-4041-8fae-e574d6c46991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:46.588848 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ddcc-0c67-4041-8fae-e574d6c46991 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:46.589123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ddcc-0c67-4041-8fae-e574d6c46991 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:46.589392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ddcc-0c67-4041-8fae-e574d6c46991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:46.590963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e496ddcc-0c67-4041-8fae-e574d6c46991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:46.684400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496ddcc-0c67-4041-8fae-e574d6c46991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:46.686008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496ddcc-0c67-4041-8fae-e574d6c46991 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:46.704862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 528/1051] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:48.895000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8a4d-d9f1-44d3-b6a4-5f9abb5b1288 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:48.895548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8a4d-d9f1-44d3-b6a4-5f9abb5b1288 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:48.895548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8a4d-d9f1-44d3-b6a4-5f9abb5b1288 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:48.897060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 524/1052] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:48.902619 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03edb3-c3ac-45ea-8893-37b68a9491a3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:48.903048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03edb3-c3ac-45ea-8893-37b68a9491a3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:48.903231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03edb3-c3ac-45ea-8893-37b68a9491a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:48.972703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ad03edb3-c3ac-45ea-8893-37b68a9491a3 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:48.973900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ad03edb3-c3ac-45ea-8893-37b68a9491a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:48.981232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:49.078176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 529/1053] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:49.361763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a8a4d-d9f1-44d3-b6a4-5f9abb5b1288 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:49.363448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-245a8a4d-d9f1-44d3-b6a4-5f9abb5b1288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:49.432347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:49.537380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a8a4d-d9f1-44d3-b6a4-5f9abb5b1288 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:49.658509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce037b-3dd4-48fd-9011-90710a8e7b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:49.659116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce037b-3dd4-48fd-9011-90710a8e7b3f service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:49.659399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce037b-3dd4-48fd-9011-90710a8e7b3f service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:49.659672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce037b-3dd4-48fd-9011-90710a8e7b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:49.661407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-81ce037b-3dd4-48fd-9011-90710a8e7b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:49.681468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:49.760896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce037b-3dd4-48fd-9011-90710a8e7b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:49.762649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce037b-3dd4-48fd-9011-90710a8e7b3f service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:49.784323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 525/1054] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:51.976773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d7ec-e51b-4083-860f-3070be1dc006 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:51.977344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d7ec-e51b-4083-860f-3070be1dc006 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:51.977344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d7ec-e51b-4083-860f-3070be1dc006 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:51.979354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 530/1055] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:51.984484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aad42-6174-4162-9a86-8ff7d096ad16 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:51.984881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aad42-6174-4162-9a86-8ff7d096ad16 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:51.985076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aad42-6174-4162-9a86-8ff7d096ad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:52.054905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-583aad42-6174-4162-9a86-8ff7d096ad16 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:52.056196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-583aad42-6174-4162-9a86-8ff7d096ad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:52.162775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:52.178672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 526/1056] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:52.480713 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d7ec-e51b-4083-860f-3070be1dc006 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:52.482223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c4f2d7ec-e51b-4083-860f-3070be1dc006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:52.634393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:52.648285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d7ec-e51b-4083-860f-3070be1dc006 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:52.787420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6836d-2b1a-4676-87ea-5fbd11d251e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:52.788282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6836d-2b1a-4676-87ea-5fbd11d251e4 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:52.788586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6836d-2b1a-4676-87ea-5fbd11d251e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:52.789002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6836d-2b1a-4676-87ea-5fbd11d251e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:52.791116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3ae6836d-2b1a-4676-87ea-5fbd11d251e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:52.885894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6836d-2b1a-4676-87ea-5fbd11d251e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:52.887414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6836d-2b1a-4676-87ea-5fbd11d251e4 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:52.897418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:52.906300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 531/1057] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:55.282937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd0b6-c755-4ace-be4c-d79f32f2255d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:55.283633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd0b6-c755-4ace-be4c-d79f32f2255d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:55.283633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd0b6-c755-4ace-be4c-d79f32f2255d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:55.284895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 527/1058] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:55.290635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57baf5-2be4-45ed-aa6e-3e2ab647057c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:55.291216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57baf5-2be4-45ed-aa6e-3e2ab647057c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:55.291216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57baf5-2be4-45ed-aa6e-3e2ab647057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:55.361431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ee57baf5-2be4-45ed-aa6e-3e2ab647057c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:55.362654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ee57baf5-2be4-45ed-aa6e-3e2ab647057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:55.475852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 532/1059] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:55.764918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd0b6-c755-4ace-be4c-d79f32f2255d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:55.766474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6ecbd0b6-c755-4ace-be4c-d79f32f2255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:55.923975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd0b6-c755-4ace-be4c-d79f32f2255d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:56.006417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:56.055227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e9a70-8fff-4f86-8ae1-a88394907f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:56.055866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e9a70-8fff-4f86-8ae1-a88394907f53 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:56.056150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e9a70-8fff-4f86-8ae1-a88394907f53 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:56.056421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e9a70-8fff-4f86-8ae1-a88394907f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:56.058015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b52e9a70-8fff-4f86-8ae1-a88394907f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:56.153230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e9a70-8fff-4f86-8ae1-a88394907f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:56.154872 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e9a70-8fff-4f86-8ae1-a88394907f53 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:56.173061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 528/1060] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:21:58.315669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde215a-07a8-4799-8902-28f8b8ac6232 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:58.316240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde215a-07a8-4799-8902-28f8b8ac6232 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:58.316240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde215a-07a8-4799-8902-28f8b8ac6232 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:58.317582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 533/1061] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:21:58.322828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be6e10-71f8-4ed6-8ed8-9db2bc2a065c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:58.323253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be6e10-71f8-4ed6-8ed8-9db2bc2a065c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:58.323371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be6e10-71f8-4ed6-8ed8-9db2bc2a065c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:58.390615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-97be6e10-71f8-4ed6-8ed8-9db2bc2a065c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:21:58.391833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-97be6e10-71f8-4ed6-8ed8-9db2bc2a065c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:58.425033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:58.488539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 529/1062] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:21:58.780029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde215a-07a8-4799-8902-28f8b8ac6232 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:21:58.781538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2fde215a-07a8-4799-8902-28f8b8ac6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:58.858621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:58.927103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde215a-07a8-4799-8902-28f8b8ac6232 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:21:59.039624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904a96-2654-4437-b07f-6b622c35cc5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:21:59.040185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904a96-2654-4437-b07f-6b622c35cc5e service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:59.040465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904a96-2654-4437-b07f-6b622c35cc5e service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:59.040734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904a96-2654-4437-b07f-6b622c35cc5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:59.042335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-53904a96-2654-4437-b07f-6b622c35cc5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:21:59.081300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:21:59.131764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53904a96-2654-4437-b07f-6b622c35cc5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:21:59.133379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53904a96-2654-4437-b07f-6b622c35cc5e service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:21:59.151416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 534/1063] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:00.007493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e74f9-b8e8-4581-ab60-cff5e2cf99e1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:00.008086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e74f9-b8e8-4581-ab60-cff5e2cf99e1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:00.008086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e74f9-b8e8-4581-ab60-cff5e2cf99e1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:00.009423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 530/1064] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:00.015403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e74e-3d21-475d-954f-796b9ec11dfd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:00.015890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e74e-3d21-475d-954f-796b9ec11dfd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:00.016127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e74e-3d21-475d-954f-796b9ec11dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:00.085006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1d18e74e-3d21-475d-954f-796b9ec11dfd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:00.086223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1d18e74e-3d21-475d-954f-796b9ec11dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:00.181993 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 535/1065] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:00.485596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0d0e2-a84a-4a2a-88d7-9eb254041b6b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:00.485880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0d0e2-a84a-4a2a-88d7-9eb254041b6b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:00.486253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0d0e2-a84a-4a2a-88d7-9eb254041b6b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:00.487535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 531/1066] 10.222.0.45 () {54 vars in 962 bytes} [Wed Oct 12 12:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:00.493097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba18c1-af79-4020-8d7f-a2e76aef632c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:00.493391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba18c1-af79-4020-8d7f-a2e76aef632c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:00.493690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba18c1-af79-4020-8d7f-a2e76aef632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:00.511575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:00.570704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-91ba18c1-af79-4020-8d7f-a2e76aef632c None None] MFA Rules not processed for user `09fb6adedea24758bd852be1702cd1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:00.571941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-91ba18c1-af79-4020-8d7f-a2e76aef632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:00.645916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 536/1067] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Oct 12 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:00.654902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0d0e2-a84a-4a2a-88d7-9eb254041b6b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:00.656439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-50c0d0e2-a84a-4a2a-88d7-9eb254041b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:00.764725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0d0e2-a84a-4a2a-88d7-9eb254041b6b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:00.826208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:00.842102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70422-2147-497d-af48-d4661c2f1217 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fb6adedea24758bd852be1702cd1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:00.842968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70422-2147-497d-af48-d4661c2f1217 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:00.843246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70422-2147-497d-af48-d4661c2f1217 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:00.843518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70422-2147-497d-af48-d4661c2f1217 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:00.845143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-43e70422-2147-497d-af48-d4661c2f1217 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:00.956056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70422-2147-497d-af48-d4661c2f1217 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:00.957493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70422-2147-497d-af48-d4661c2f1217 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:00.976003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 532/1068] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:01.334895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd724-9142-4357-8148-73d3195edd1e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:01.335455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd724-9142-4357-8148-73d3195edd1e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:01.335455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd724-9142-4357-8148-73d3195edd1e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:01.336868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 537/1069] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:01.342060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:01.342779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:01.342881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:01.416412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:01.417506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:01.458896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:01.518628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 533/1070] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:01.716564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b57e6-4425-4d6f-b2c8-8024cf499b7a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:01.716899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b57e6-4425-4d6f-b2c8-8024cf499b7a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:01.717198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b57e6-4425-4d6f-b2c8-8024cf499b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:01.783285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-360b57e6-4425-4d6f-b2c8-8024cf499b7a None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:01.784509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-360b57e6-4425-4d6f-b2c8-8024cf499b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:01.817365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:01.818669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:01.841743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:01.874573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 538/1071] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:01.923227 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c3268-56d2-4c7b-8b49-6edb054463b3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:01.923587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c3268-56d2-4c7b-8b49-6edb054463b3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:01.923908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c3268-56d2-4c7b-8b49-6edb054463b3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:01.925258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 539/1072] 10.222.0.45 () {54 vars in 943 bytes} [Wed Oct 12 12:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:01.931503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977562-20c0-41ec-af6c-3e784b9cd82e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:01.931883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977562-20c0-41ec-af6c-3e784b9cd82e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:01.932257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977562-20c0-41ec-af6c-3e784b9cd82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:01.936822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4c756-e11c-409c-953a-72032fd90521 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:01.994588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:02.009615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1c977562-20c0-41ec-af6c-3e784b9cd82e None None] MFA Rules not processed for user `bc6e24255b28424ebb02c9319b40b25d`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:02.010832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1c977562-20c0-41ec-af6c-3e784b9cd82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:02.052829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668915d2-8faf-40ad-a643-f66cd8a79b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:02.053433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668915d2-8faf-40ad-a643-f66cd8a79b89 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:02.053708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668915d2-8faf-40ad-a643-f66cd8a79b89 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:02.053976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668915d2-8faf-40ad-a643-f66cd8a79b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:02.055531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-668915d2-8faf-40ad-a643-f66cd8a79b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:02.122067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 540/1073] 10.222.0.45 () {58 vars in 1040 bytes} [Wed Oct 12 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:02.131608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977562-20c0-41ec-af6c-3e784b9cd82e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:02.141681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977562-20c0-41ec-af6c-3e784b9cd82e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:02.144781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668915d2-8faf-40ad-a643-f66cd8a79b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:02.146407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668915d2-8faf-40ad-a643-f66cd8a79b89 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:02.164089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 534/1074] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:02.167196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:02.255252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f9511-9b8c-4c1d-add2-94a9300dec69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:02.255811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9511-9b8c-4c1d-add2-94a9300dec69 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:02.256111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9511-9b8c-4c1d-add2-94a9300dec69 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:02.256384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9511-9b8c-4c1d-add2-94a9300dec69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:02.258140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-392f9511-9b8c-4c1d-add2-94a9300dec69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:02.352127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f9511-9b8c-4c1d-add2-94a9300dec69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:02.353765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f9511-9b8c-4c1d-add2-94a9300dec69 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:02.363570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 541/1075] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:22:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 12:22:04.388325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344426bb-0609-480e-9d1b-6d4e63a28b52 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:04.388898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344426bb-0609-480e-9d1b-6d4e63a28b52 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:04.388898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344426bb-0609-480e-9d1b-6d4e63a28b52 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:04.390208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 535/1076] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:04.395450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a01b-b3ae-419c-93ed-2de561c75100 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:04.395872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a01b-b3ae-419c-93ed-2de561c75100 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:04.396123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a01b-b3ae-419c-93ed-2de561c75100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:04.464828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ccc6a01b-b3ae-419c-93ed-2de561c75100 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:04.466158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ccc6a01b-b3ae-419c-93ed-2de561c75100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:04.474005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:04.580878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 542/1077] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:04.870744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344426bb-0609-480e-9d1b-6d4e63a28b52 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:04.872976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-344426bb-0609-480e-9d1b-6d4e63a28b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:04.950880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:05.042243 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344426bb-0609-480e-9d1b-6d4e63a28b52 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:05.167431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d3e7-8164-4492-911f-828291e6a2fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:05.168201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d3e7-8164-4492-911f-828291e6a2fa service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:05.168485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d3e7-8164-4492-911f-828291e6a2fa service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:05.168756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d3e7-8164-4492-911f-828291e6a2fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:05.170336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9777d3e7-8164-4492-911f-828291e6a2fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:05.201362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:05.274232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d3e7-8164-4492-911f-828291e6a2fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:05.275879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d3e7-8164-4492-911f-828291e6a2fa service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:05.297326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 536/1078] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:07.498771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc11f0f-d2dd-43dc-bc95-d3e73b0526d4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:07.499323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc11f0f-d2dd-43dc-bc95-d3e73b0526d4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:07.499323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc11f0f-d2dd-43dc-bc95-d3e73b0526d4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:07.504129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 543/1079] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:22:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:07.505926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a4bd-3035-498a-a1b9-ec3c70371c7f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:07.506321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a4bd-3035-498a-a1b9-ec3c70371c7f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:07.506485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a4bd-3035-498a-a1b9-ec3c70371c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:07.581874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f4b8a4bd-3035-498a-a1b9-ec3c70371c7f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:07.583079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f4b8a4bd-3035-498a-a1b9-ec3c70371c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:07.715317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 537/1080] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:07.998242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc11f0f-d2dd-43dc-bc95-d3e73b0526d4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:07.999841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ebc11f0f-d2dd-43dc-bc95-d3e73b0526d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:08.147479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.158535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc11f0f-d2dd-43dc-bc95-d3e73b0526d4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.281338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bfddb-9cbb-47f3-83f8-d486efbec4e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.281866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bfddb-9cbb-47f3-83f8-d486efbec4e8 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.282143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bfddb-9cbb-47f3-83f8-d486efbec4e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.282413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bfddb-9cbb-47f3-83f8-d486efbec4e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.284041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3e4bfddb-9cbb-47f3-83f8-d486efbec4e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:08.387117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bfddb-9cbb-47f3-83f8-d486efbec4e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.388840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bfddb-9cbb-47f3-83f8-d486efbec4e8 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.398860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.409373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 544/1081] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:10.623183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d376-57ee-492c-ac30-754748c02741 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:10.623756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d376-57ee-492c-ac30-754748c02741 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:10.623756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d376-57ee-492c-ac30-754748c02741 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:10.625254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 538/1082] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:10.630239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e746eb-34e8-479e-b60e-f876311fe730 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:10.630650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e746eb-34e8-479e-b60e-f876311fe730 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:10.630796 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e746eb-34e8-479e-b60e-f876311fe730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:10.710849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-17e746eb-34e8-479e-b60e-f876311fe730 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:10.710849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-17e746eb-34e8-479e-b60e-f876311fe730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:10.823947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 545/1083] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:11.117417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034d376-57ee-492c-ac30-754748c02741 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:11.118930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3034d376-57ee-492c-ac30-754748c02741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:11.122429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:11.280789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034d376-57ee-492c-ac30-754748c02741 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:11.369468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:11.413271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1ad9c-68ac-447e-a3dd-05826e69f241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:11.414052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1ad9c-68ac-447e-a3dd-05826e69f241 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:11.414558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1ad9c-68ac-447e-a3dd-05826e69f241 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:11.415119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1ad9c-68ac-447e-a3dd-05826e69f241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:11.416825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-41f1ad9c-68ac-447e-a3dd-05826e69f241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:11.520725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1ad9c-68ac-447e-a3dd-05826e69f241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:11.522322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1ad9c-68ac-447e-a3dd-05826e69f241 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:11.545594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 539/1084] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:20.821598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=67 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:21.539140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=61 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.673656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25c6bd-c6f4-4dca-aaed-033f35797b40 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.674200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25c6bd-c6f4-4dca-aaed-033f35797b40 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.674200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25c6bd-c6f4-4dca-aaed-033f35797b40 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.675586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 546/1085] 10.222.0.45 () {54 vars in 918 bytes} [Wed Oct 12 12:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:24.680649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1875d-e129-4e1a-871b-c7c9e4fe6473 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.681091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1875d-e129-4e1a-871b-c7c9e4fe6473 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.681223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1875d-e129-4e1a-871b-c7c9e4fe6473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.755652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a5d1875d-e129-4e1a-871b-c7c9e4fe6473 None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:24.756886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a5d1875d-e129-4e1a-871b-c7c9e4fe6473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:24.861617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 540/1086] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 12 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:24.875755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242d003-2cb1-45c0-9efb-d13a811a19db None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.876081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242d003-2cb1-45c0-9efb-d13a811a19db None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.876355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242d003-2cb1-45c0-9efb-d13a811a19db None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.877671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 547/1087] 10.222.0.45 () {54 vars in 918 bytes} [Wed Oct 12 12:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:24.882489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec602a-68cd-4413-abd7-20b8411eb062 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.882777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec602a-68cd-4413-abd7-20b8411eb062 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.883051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec602a-68cd-4413-abd7-20b8411eb062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.956487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.959578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-84ec602a-68cd-4413-abd7-20b8411eb062 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:24.961442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-84ec602a-68cd-4413-abd7-20b8411eb062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:25.077238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 541/1088] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 12 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:27.614395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21e9a-8e17-4c76-95d6-9bbaf2b68027 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:27.614959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21e9a-8e17-4c76-95d6-9bbaf2b68027 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:27.614959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21e9a-8e17-4c76-95d6-9bbaf2b68027 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:27.616323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 548/1089] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:27.622077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95322e-3948-4c63-a5bb-bb018afaa194 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:27.622491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95322e-3948-4c63-a5bb-bb018afaa194 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:27.622632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95322e-3948-4c63-a5bb-bb018afaa194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:27.688537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ca95322e-3948-4c63-a5bb-bb018afaa194 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:27.689728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ca95322e-3948-4c63-a5bb-bb018afaa194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:27.744056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:27.785055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 542/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:28.072301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21e9a-8e17-4c76-95d6-9bbaf2b68027 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:28.073884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-35a21e9a-8e17-4c76-95d6-9bbaf2b68027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:28.217502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21e9a-8e17-4c76-95d6-9bbaf2b68027 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:28.288399 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:28.327467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a3658-85e5-4364-9382-6e1fe269121d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:28.328092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3658-85e5-4364-9382-6e1fe269121d service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.328372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3658-85e5-4364-9382-6e1fe269121d service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.328639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3658-85e5-4364-9382-6e1fe269121d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.330209 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bc6a3658-85e5-4364-9382-6e1fe269121d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:28.417897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a3658-85e5-4364-9382-6e1fe269121d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:28.420034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a3658-85e5-4364-9382-6e1fe269121d service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:28.437476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 549/1091] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:29.577300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598030e-1920-4a12-a716-02ffd4d409e1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.577828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598030e-1920-4a12-a716-02ffd4d409e1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.577828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598030e-1920-4a12-a716-02ffd4d409e1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.579190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 543/1092] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:29.585457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ed876-9fa4-41f4-8642-96e4363c1603 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.585850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ed876-9fa4-41f4-8642-96e4363c1603 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.586002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ed876-9fa4-41f4-8642-96e4363c1603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.661276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-370ed876-9fa4-41f4-8642-96e4363c1603 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:29.662483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-370ed876-9fa4-41f4-8642-96e4363c1603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:29.689136 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.757832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 550/1093] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:29.908425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598030e-1920-4a12-a716-02ffd4d409e1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:29.910012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9598030e-1920-4a12-a716-02ffd4d409e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:30.053831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598030e-1920-4a12-a716-02ffd4d409e1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.094287 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.168900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16247-c59b-4629-a15d-4e507456c5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.169497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16247-c59b-4629-a15d-4e507456c5fc service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.169771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16247-c59b-4629-a15d-4e507456c5fc service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.170035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16247-c59b-4629-a15d-4e507456c5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.171597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-16d16247-c59b-4629-a15d-4e507456c5fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:30.259269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d16247-c59b-4629-a15d-4e507456c5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.260892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d16247-c59b-4629-a15d-4e507456c5fc service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.278538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 544/1094] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:31.406170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a69111-8757-4e04-893b-a4b9b09d57fb None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.406742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a69111-8757-4e04-893b-a4b9b09d57fb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.406857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a69111-8757-4e04-893b-a4b9b09d57fb None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.408211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 551/1095] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:31.414429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01ef81-bcf7-43ab-9b47-2a11cc2c56ce None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.414861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01ef81-bcf7-43ab-9b47-2a11cc2c56ce None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.415020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01ef81-bcf7-43ab-9b47-2a11cc2c56ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.469480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.491821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5c01ef81-bcf7-43ab-9b47-2a11cc2c56ce None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:31.492981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5c01ef81-bcf7-43ab-9b47-2a11cc2c56ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:31.587449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 545/1096] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:31.739152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a69111-8757-4e04-893b-a4b9b09d57fb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.740629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-96a69111-8757-4e04-893b-a4b9b09d57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:31.885376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a69111-8757-4e04-893b-a4b9b09d57fb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.897990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.997852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b410bba-0791-478e-8329-569ea7e86f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.998372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410bba-0791-478e-8329-569ea7e86f59 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.998659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410bba-0791-478e-8329-569ea7e86f59 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.998929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410bba-0791-478e-8329-569ea7e86f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:32.000555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7b410bba-0791-478e-8329-569ea7e86f59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:32.088215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b410bba-0791-478e-8329-569ea7e86f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:32.089792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b410bba-0791-478e-8329-569ea7e86f59 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:32.107744 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 552/1097] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:33.208360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece746-4493-48eb-a285-26a3d2c288ef None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:33.208935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece746-4493-48eb-a285-26a3d2c288ef None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:33.208935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece746-4493-48eb-a285-26a3d2c288ef None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:33.210242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 546/1098] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:33.217043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7b85-abe8-48dd-b970-b3e97396ae4f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:33.217459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7b85-abe8-48dd-b970-b3e97396ae4f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:33.217635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7b85-abe8-48dd-b970-b3e97396ae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:33.237135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:33.293535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d5db7b85-abe8-48dd-b970-b3e97396ae4f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:33.294729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d5db7b85-abe8-48dd-b970-b3e97396ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:33.388884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 553/1099] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:33.536940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece746-4493-48eb-a285-26a3d2c288ef None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:33.538445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f9ece746-4493-48eb-a285-26a3d2c288ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:33.646780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:33.681670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece746-4493-48eb-a285-26a3d2c288ef None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:33.795511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4213eb4-209b-4603-98b5-efd7f79f495d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:33.796149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213eb4-209b-4603-98b5-efd7f79f495d service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:33.796427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213eb4-209b-4603-98b5-efd7f79f495d service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:33.796692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213eb4-209b-4603-98b5-efd7f79f495d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:33.798258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f4213eb4-209b-4603-98b5-efd7f79f495d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:33.873015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:33.886784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4213eb4-209b-4603-98b5-efd7f79f495d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:33.888395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4213eb4-209b-4603-98b5-efd7f79f495d service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:33.905836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 547/1100] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:35.003746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9afc30-80b4-4023-90cf-e6c7560d2bac None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:35.004363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9afc30-80b4-4023-90cf-e6c7560d2bac None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:35.004363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9afc30-80b4-4023-90cf-e6c7560d2bac None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:35.005657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 554/1101] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:35.011788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707a8e-eae1-4f9e-a414-17518e288cbc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:35.012252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707a8e-eae1-4f9e-a414-17518e288cbc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:35.012400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707a8e-eae1-4f9e-a414-17518e288cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:35.088441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9f707a8e-eae1-4f9e-a414-17518e288cbc None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:35.089654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f707a8e-eae1-4f9e-a414-17518e288cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:35.184612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 548/1102] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:35.335214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9afc30-80b4-4023-90cf-e6c7560d2bac None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:35.336767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cb9afc30-80b4-4023-90cf-e6c7560d2bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:35.420986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:35.481273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9afc30-80b4-4023-90cf-e6c7560d2bac None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:35.591626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52288c00-f79a-4bd8-b143-82652f179ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:35.592284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288c00-f79a-4bd8-b143-82652f179ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:35.592695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288c00-f79a-4bd8-b143-82652f179ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:35.592962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52288c00-f79a-4bd8-b143-82652f179ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:35.594539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-52288c00-f79a-4bd8-b143-82652f179ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:35.641621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:35.681861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52288c00-f79a-4bd8-b143-82652f179ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:35.683419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52288c00-f79a-4bd8-b143-82652f179ed0 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:35.701916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 555/1103] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:36.746986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbf24-d0c3-4a82-af9f-132f36220386 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.747466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbf24-d0c3-4a82-af9f-132f36220386 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.747579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbf24-d0c3-4a82-af9f-132f36220386 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.748912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 549/1104] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:36.754863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059bd2-5afb-4246-a418-ec80d64f6da2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.755323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059bd2-5afb-4246-a418-ec80d64f6da2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.755420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059bd2-5afb-4246-a418-ec80d64f6da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.829382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f6059bd2-5afb-4246-a418-ec80d64f6da2 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:36.830563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f6059bd2-5afb-4246-a418-ec80d64f6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:36.924555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 556/1105] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:37.073477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abbf24-d0c3-4a82-af9f-132f36220386 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:37.075512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-40abbf24-d0c3-4a82-af9f-132f36220386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:37.124601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:37.218820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abbf24-d0c3-4a82-af9f-132f36220386 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.329702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf6b2-3842-49ec-a864-239466cccc49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.330295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf6b2-3842-49ec-a864-239466cccc49 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.330570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf6b2-3842-49ec-a864-239466cccc49 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.330835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf6b2-3842-49ec-a864-239466cccc49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.332415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9fecf6b2-3842-49ec-a864-239466cccc49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:37.339071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:37.420173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecf6b2-3842-49ec-a864-239466cccc49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.421757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecf6b2-3842-49ec-a864-239466cccc49 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.439929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 550/1106] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:38.490046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e5ae-4a1b-40ed-9d1d-4d5800f14a42 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:38.490735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e5ae-4a1b-40ed-9d1d-4d5800f14a42 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:38.490735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e5ae-4a1b-40ed-9d1d-4d5800f14a42 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:38.492024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 557/1107] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:38.498239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647318f8-ef85-48f4-8340-65c6b30bb2e6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:38.498688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647318f8-ef85-48f4-8340-65c6b30bb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:38.498815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647318f8-ef85-48f4-8340-65c6b30bb2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:38.574299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-647318f8-ef85-48f4-8340-65c6b30bb2e6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:38.576033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-647318f8-ef85-48f4-8340-65c6b30bb2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:38.643141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:38.671154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 551/1108] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:38.819897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e5ae-4a1b-40ed-9d1d-4d5800f14a42 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:38.821402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2a09e5ae-4a1b-40ed-9d1d-4d5800f14a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:38.838886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:38.963424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e5ae-4a1b-40ed-9d1d-4d5800f14a42 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:39.048425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:39.073728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804652-2710-4c11-8448-80aed3d3aaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:39.074330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804652-2710-4c11-8448-80aed3d3aaf0 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.074613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804652-2710-4c11-8448-80aed3d3aaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.074906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804652-2710-4c11-8448-80aed3d3aaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.076515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7b804652-2710-4c11-8448-80aed3d3aaf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:39.162385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804652-2710-4c11-8448-80aed3d3aaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:39.164002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804652-2710-4c11-8448-80aed3d3aaf0 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:39.181828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 558/1109] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:40.238124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51312c4-617c-4cf2-a5cb-2a035e795819 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.238729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51312c4-617c-4cf2-a5cb-2a035e795819 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.238729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51312c4-617c-4cf2-a5cb-2a035e795819 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.240045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 552/1110] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:40.246277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645022aa-e904-428d-aecf-bc08b884198f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.246707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645022aa-e904-428d-aecf-bc08b884198f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.246853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645022aa-e904-428d-aecf-bc08b884198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.320004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-645022aa-e904-428d-aecf-bc08b884198f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:40.321185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-645022aa-e904-428d-aecf-bc08b884198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:40.363462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.417430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 559/1111] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:40.566665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51312c4-617c-4cf2-a5cb-2a035e795819 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.568289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e51312c4-617c-4cf2-a5cb-2a035e795819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:40.711214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51312c4-617c-4cf2-a5cb-2a035e795819 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.764434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.822196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e39bd4-de6a-48df-ac3e-6845b3bd7680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.822740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39bd4-de6a-48df-ac3e-6845b3bd7680 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.823022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39bd4-de6a-48df-ac3e-6845b3bd7680 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.823295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39bd4-de6a-48df-ac3e-6845b3bd7680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.825427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b9e39bd4-de6a-48df-ac3e-6845b3bd7680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:40.914237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e39bd4-de6a-48df-ac3e-6845b3bd7680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:40.915857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e39bd4-de6a-48df-ac3e-6845b3bd7680 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:40.933348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 553/1112] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:41.981991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a3bb-898f-4e43-aeca-c31deb1f62a9 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.982569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a3bb-898f-4e43-aeca-c31deb1f62a9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.982569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a3bb-898f-4e43-aeca-c31deb1f62a9 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.983922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 560/1113] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:41.989995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8c4f-4213-4492-9222-f549f5114fcd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.990427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8c4f-4213-4492-9222-f549f5114fcd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.990602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8c4f-4213-4492-9222-f549f5114fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:42.065031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d48d8c4f-4213-4492-9222-f549f5114fcd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:42.066165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d48d8c4f-4213-4492-9222-f549f5114fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:42.068172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:42.163375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 554/1114] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:42.313494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a3bb-898f-4e43-aeca-c31deb1f62a9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:42.315005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d1d5a3bb-898f-4e43-aeca-c31deb1f62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:42.456554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a3bb-898f-4e43-aeca-c31deb1f62a9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:42.482814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:42.568415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac075ad-9198-4cbf-af14-497973bf1fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:42.569019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac075ad-9198-4cbf-af14-497973bf1fa6 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:42.569316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac075ad-9198-4cbf-af14-497973bf1fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:42.569584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac075ad-9198-4cbf-af14-497973bf1fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:42.571203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8ac075ad-9198-4cbf-af14-497973bf1fa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:42.658948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac075ad-9198-4cbf-af14-497973bf1fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:42.660557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac075ad-9198-4cbf-af14-497973bf1fa6 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:42.678175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 561/1115] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:44.728162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49538-1de8-4671-a6da-3d89468a6750 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.728695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49538-1de8-4671-a6da-3d89468a6750 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.728695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49538-1de8-4671-a6da-3d89468a6750 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.730025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 555/1116] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:44.735234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e478d-9956-4683-a1d0-adc5d1e489e9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.735682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e478d-9956-4683-a1d0-adc5d1e489e9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.735820 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e478d-9956-4683-a1d0-adc5d1e489e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.787480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:44.806045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-414e478d-9956-4683-a1d0-adc5d1e489e9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:44.807241 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-414e478d-9956-4683-a1d0-adc5d1e489e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:44.902907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 562/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:45.188177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e49538-1de8-4671-a6da-3d89468a6750 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:45.189737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b2e49538-1de8-4671-a6da-3d89468a6750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:45.292248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e49538-1de8-4671-a6da-3d89468a6750 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:45.324792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:45.366736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba07a3b-befc-45ac-8fe5-b473baea0027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:45.367357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba07a3b-befc-45ac-8fe5-b473baea0027 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:45.367634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba07a3b-befc-45ac-8fe5-b473baea0027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:45.367933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba07a3b-befc-45ac-8fe5-b473baea0027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:45.369502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bba07a3b-befc-45ac-8fe5-b473baea0027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:45.475042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba07a3b-befc-45ac-8fe5-b473baea0027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:45.476423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba07a3b-befc-45ac-8fe5-b473baea0027 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:45.495761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 556/1118] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:47.761254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044e1f4-ed58-402b-9557-b0aca345582b None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.761786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044e1f4-ed58-402b-9557-b0aca345582b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.761786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044e1f4-ed58-402b-9557-b0aca345582b None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.764095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 563/1119] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:47.769401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590839d-fc00-4e2b-9cdb-06c6521009cb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.769823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590839d-fc00-4e2b-9cdb-06c6521009cb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.769957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590839d-fc00-4e2b-9cdb-06c6521009cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.834643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7590839d-fc00-4e2b-9cdb-06c6521009cb None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:47.835856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7590839d-fc00-4e2b-9cdb-06c6521009cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:47.848522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:47.929810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 557/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:48.214646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044e1f4-ed58-402b-9557-b0aca345582b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:48.216199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0044e1f4-ed58-402b-9557-b0aca345582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:48.316072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044e1f4-ed58-402b-9557-b0aca345582b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:48.328483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:48.389213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cc39b-e3c7-4a7b-a2aa-5551c14e9e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:48.389811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc39b-e3c7-4a7b-a2aa-5551c14e9e75 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:48.390089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc39b-e3c7-4a7b-a2aa-5551c14e9e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:48.390844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc39b-e3c7-4a7b-a2aa-5551c14e9e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:48.392469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-984cc39b-e3c7-4a7b-a2aa-5551c14e9e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:48.499903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cc39b-e3c7-4a7b-a2aa-5551c14e9e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:48.501335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cc39b-e3c7-4a7b-a2aa-5551c14e9e75 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:48.519019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 564/1121] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:50.968587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ff25-506e-4be9-9fd3-2fd6e97f4ed7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.969137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ff25-506e-4be9-9fd3-2fd6e97f4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.969137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ff25-506e-4be9-9fd3-2fd6e97f4ed7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.970454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 558/1122] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:50.976126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed05e9-cc52-4ab1-b9fa-89634cda2ec3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.976547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed05e9-cc52-4ab1-b9fa-89634cda2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.976658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed05e9-cc52-4ab1-b9fa-89634cda2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:51.023679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:51.041997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-42ed05e9-cc52-4ab1-b9fa-89634cda2ec3 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:51.043122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-42ed05e9-cc52-4ab1-b9fa-89634cda2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:51.137313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 565/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:51.420566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ff25-506e-4be9-9fd3-2fd6e97f4ed7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:51.422089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0d77ff25-506e-4be9-9fd3-2fd6e97f4ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:51.524517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ff25-506e-4be9-9fd3-2fd6e97f4ed7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:51.565221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:51.598762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79a1e2-ee11-4fa5-99b2-4d82901ba821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:51.599352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79a1e2-ee11-4fa5-99b2-4d82901ba821 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:51.599628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79a1e2-ee11-4fa5-99b2-4d82901ba821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:51.599925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79a1e2-ee11-4fa5-99b2-4d82901ba821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:51.601520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0e79a1e2-ee11-4fa5-99b2-4d82901ba821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:51.710096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79a1e2-ee11-4fa5-99b2-4d82901ba821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:51.711458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79a1e2-ee11-4fa5-99b2-4d82901ba821 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:51.729702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 559/1124] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:54.014757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5427b-5e25-42dd-879f-f942fd4072b1 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:54.015326 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5427b-5e25-42dd-879f-f942fd4072b1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:54.015326 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5427b-5e25-42dd-879f-f942fd4072b1 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:54.016695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 566/1125] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:54.021963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411ff1a-a5b2-496b-bd02-2177e7dc3c25 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:54.022358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411ff1a-a5b2-496b-bd02-2177e7dc3c25 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:54.022521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411ff1a-a5b2-496b-bd02-2177e7dc3c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:54.088153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b411ff1a-a5b2-496b-bd02-2177e7dc3c25 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:54.089356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b411ff1a-a5b2-496b-bd02-2177e7dc3c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:54.110360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:54.183593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 560/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:54.473815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5427b-5e25-42dd-879f-f942fd4072b1 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:54.475370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5ba5427b-5e25-42dd-879f-f942fd4072b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:54.576589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5427b-5e25-42dd-879f-f942fd4072b1 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:54.596069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:54.647952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348899a-8081-45e6-a860-c43efa307ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:54.648543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348899a-8081-45e6-a860-c43efa307ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:54.648817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348899a-8081-45e6-a860-c43efa307ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:54.649085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348899a-8081-45e6-a860-c43efa307ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:54.650650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3348899a-8081-45e6-a860-c43efa307ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:54.756380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348899a-8081-45e6-a860-c43efa307ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:54.757739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348899a-8081-45e6-a860-c43efa307ac7 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:54.776210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 567/1127] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:22:57.080818 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfa1c5-f60e-416e-ba99-6b19ce03ea8d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.081358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfa1c5-f60e-416e-ba99-6b19ce03ea8d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.081358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfa1c5-f60e-416e-ba99-6b19ce03ea8d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.082703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 561/1128] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:57.088171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea29132-f28c-42b5-b36f-8ee1e3f2187b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.088576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea29132-f28c-42b5-b36f-8ee1e3f2187b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.088730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea29132-f28c-42b5-b36f-8ee1e3f2187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.151152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:57.154712 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4ea29132-f28c-42b5-b36f-8ee1e3f2187b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:57.156251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4ea29132-f28c-42b5-b36f-8ee1e3f2187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:57.254695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 568/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:22:57.544245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfa1c5-f60e-416e-ba99-6b19ce03ea8d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:57.546346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e8bfa1c5-f60e-416e-ba99-6b19ce03ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:57.648019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfa1c5-f60e-416e-ba99-6b19ce03ea8d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:57.697958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:57.723291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bee603-0e7c-4993-bc5b-2787427eff73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:57.723919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee603-0e7c-4993-bc5b-2787427eff73 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.724200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee603-0e7c-4993-bc5b-2787427eff73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.724473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee603-0e7c-4993-bc5b-2787427eff73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.726058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e1bee603-0e7c-4993-bc5b-2787427eff73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:57.834246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bee603-0e7c-4993-bc5b-2787427eff73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:57.835682 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bee603-0e7c-4993-bc5b-2787427eff73 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:57.854195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 562/1130] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:00.046019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac48ca-575a-4198-ab38-99f85b96d8f0 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.046530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac48ca-575a-4198-ab38-99f85b96d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.046530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac48ca-575a-4198-ab38-99f85b96d8f0 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.047832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 569/1131] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:00.053241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41b995-252f-4409-9cca-ec07d9d0fcfa None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.053639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41b995-252f-4409-9cca-ec07d9d0fcfa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.053791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41b995-252f-4409-9cca-ec07d9d0fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.137849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ef41b995-252f-4409-9cca-ec07d9d0fcfa None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:00.139064 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ef41b995-252f-4409-9cca-ec07d9d0fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:00.167666 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:00.235733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 563/1132] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:00.518469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac48ca-575a-4198-ab38-99f85b96d8f0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:00.520074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-73ac48ca-575a-4198-ab38-99f85b96d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:00.622891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac48ca-575a-4198-ab38-99f85b96d8f0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:00.650398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:00.695622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35431f8c-4402-469d-a32c-c0e70a9b62cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:00.696251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431f8c-4402-469d-a32c-c0e70a9b62cd service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.696529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431f8c-4402-469d-a32c-c0e70a9b62cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.696806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431f8c-4402-469d-a32c-c0e70a9b62cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.698385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-35431f8c-4402-469d-a32c-c0e70a9b62cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:00.805095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35431f8c-4402-469d-a32c-c0e70a9b62cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:00.806524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35431f8c-4402-469d-a32c-c0e70a9b62cd service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:00.823931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 570/1133] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:03.019428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f675b6-2e57-4b91-bd7b-a248322e6a8d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.020010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f675b6-2e57-4b91-bd7b-a248322e6a8d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.020010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f675b6-2e57-4b91-bd7b-a248322e6a8d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.021348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 564/1134] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:03.026582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae0ff8-e4e6-4622-b24c-016bda32cee9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.026978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae0ff8-e4e6-4622-b24c-016bda32cee9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.027084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae0ff8-e4e6-4622-b24c-016bda32cee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.091430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3cae0ff8-e4e6-4622-b24c-016bda32cee9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:03.093242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3cae0ff8-e4e6-4622-b24c-016bda32cee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:03.101476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.187630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 571/1135] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:03.469082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f675b6-2e57-4b91-bd7b-a248322e6a8d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.470641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-30f675b6-2e57-4b91-bd7b-a248322e6a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:03.573136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f675b6-2e57-4b91-bd7b-a248322e6a8d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.628927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.647004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52da9f-770b-4f18-bf00-669d2405d3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.647605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52da9f-770b-4f18-bf00-669d2405d3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.647918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52da9f-770b-4f18-bf00-669d2405d3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.648192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52da9f-770b-4f18-bf00-669d2405d3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.649785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2a52da9f-770b-4f18-bf00-669d2405d3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:03.757892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52da9f-770b-4f18-bf00-669d2405d3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.759331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52da9f-770b-4f18-bf00-669d2405d3a3 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.777248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 565/1136] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:05.968808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d77b-2bb0-4050-adad-b5226b1aea17 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:05.969381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d77b-2bb0-4050-adad-b5226b1aea17 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:05.969381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559d77b-2bb0-4050-adad-b5226b1aea17 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:05.970726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 572/1137] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:05.976235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38725d8-a285-42ad-ae70-1913a7d3f87a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:05.976669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38725d8-a285-42ad-ae70-1913a7d3f87a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:05.976795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38725d8-a285-42ad-ae70-1913a7d3f87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:06.042510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a38725d8-a285-42ad-ae70-1913a7d3f87a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:06.043648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a38725d8-a285-42ad-ae70-1913a7d3f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:06.081362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:06.137039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 566/1138] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:06.416824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d77b-2bb0-4050-adad-b5226b1aea17 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:06.418355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8559d77b-2bb0-4050-adad-b5226b1aea17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:06.520157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559d77b-2bb0-4050-adad-b5226b1aea17 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:06.557182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:06.592572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5fb5c-e53a-418c-ab0b-2acfafddf68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:06.593189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5fb5c-e53a-418c-ab0b-2acfafddf68c service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:06.593472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5fb5c-e53a-418c-ab0b-2acfafddf68c service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:06.593741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5fb5c-e53a-418c-ab0b-2acfafddf68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:06.595315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a2f5fb5c-e53a-418c-ab0b-2acfafddf68c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:06.701835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5fb5c-e53a-418c-ab0b-2acfafddf68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:06.703194 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5fb5c-e53a-418c-ab0b-2acfafddf68c service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:06.721679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 573/1139] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:08.866375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef772-8400-4456-a149-6ee2b34573dc None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.866893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef772-8400-4456-a149-6ee2b34573dc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.867009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef772-8400-4456-a149-6ee2b34573dc None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.868314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 567/1140] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:08.874057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a364e44-6273-40bd-8364-14bb9fbddc48 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.874479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a364e44-6273-40bd-8364-14bb9fbddc48 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.874584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a364e44-6273-40bd-8364-14bb9fbddc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.938588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6a364e44-6273-40bd-8364-14bb9fbddc48 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:08.939781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6a364e44-6273-40bd-8364-14bb9fbddc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:08.957614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:09.033270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 574/1141] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:09.313404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef772-8400-4456-a149-6ee2b34573dc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:09.314940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-effef772-8400-4456-a149-6ee2b34573dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:09.417521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef772-8400-4456-a149-6ee2b34573dc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:09.483144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:09.489460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4b37c-c3b4-43af-8992-5db3e1369148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:09.490055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b37c-c3b4-43af-8992-5db3e1369148 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:09.490331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b37c-c3b4-43af-8992-5db3e1369148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:09.490598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b37c-c3b4-43af-8992-5db3e1369148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:09.492250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-41f4b37c-c3b4-43af-8992-5db3e1369148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:09.600418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4b37c-c3b4-43af-8992-5db3e1369148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:09.601840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4b37c-c3b4-43af-8992-5db3e1369148 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:09.620178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 568/1142] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:11.759629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691945f0-4389-41a7-aa75-93580d5b960b None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.760272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691945f0-4389-41a7-aa75-93580d5b960b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.760272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691945f0-4389-41a7-aa75-93580d5b960b None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.761548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 575/1143] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:11.766984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a712-1ca1-471b-92e0-179b3d8a8817 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.767399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a712-1ca1-471b-92e0-179b3d8a8817 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.767512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a712-1ca1-471b-92e0-179b3d8a8817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.832559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-22d9a712-1ca1-471b-92e0-179b3d8a8817 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:11.833754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-22d9a712-1ca1-471b-92e0-179b3d8a8817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:11.881268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:11.929297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 569/1144] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:12.209087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691945f0-4389-41a7-aa75-93580d5b960b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.210635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-691945f0-4389-41a7-aa75-93580d5b960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:12.311393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691945f0-4389-41a7-aa75-93580d5b960b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.361583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:12.387217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae18f3-6d47-4d1f-900a-df65f52d273d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.387846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae18f3-6d47-4d1f-900a-df65f52d273d service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.388131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae18f3-6d47-4d1f-900a-df65f52d273d service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.388408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae18f3-6d47-4d1f-900a-df65f52d273d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.390561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c0ae18f3-6d47-4d1f-900a-df65f52d273d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:12.498045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae18f3-6d47-4d1f-900a-df65f52d273d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:12.499721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae18f3-6d47-4d1f-900a-df65f52d273d service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:12.517608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 576/1145] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:21.927821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=22 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.515359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=66 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.323343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2467-5920-41cf-b037-4870946ea52a None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.323956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2467-5920-41cf-b037-4870946ea52a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.323956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2467-5920-41cf-b037-4870946ea52a None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.325304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 570/1146] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:32.331199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790b0a-6f70-4000-9306-db9517031600 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.331641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790b0a-6f70-4000-9306-db9517031600 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.331824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790b0a-6f70-4000-9306-db9517031600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.397451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ee790b0a-6f70-4000-9306-db9517031600 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:32.398642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ee790b0a-6f70-4000-9306-db9517031600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:32.492451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 577/1147] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:32.791566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b438-3ae9-481c-be75-1b91d32fd72e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.791886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b438-3ae9-481c-be75-1b91d32fd72e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.792159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b438-3ae9-481c-be75-1b91d32fd72e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.793477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 571/1148] 10.222.0.45 () {54 vars in 962 bytes} [Wed Oct 12 12:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:32.798843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c36a-8b66-457b-b7e0-abd6eb7dfe63 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.799128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c36a-8b66-457b-b7e0-abd6eb7dfe63 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.799402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c36a-8b66-457b-b7e0-abd6eb7dfe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.874085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-01b9c36a-8b66-457b-b7e0-abd6eb7dfe63 None None] MFA Rules not processed for user `09fb6adedea24758bd852be1702cd1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:32.875272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-01b9c36a-8b66-457b-b7e0-abd6eb7dfe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:32.895460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.950466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 578/1149] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Oct 12 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:32.958328 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b438-3ae9-481c-be75-1b91d32fd72e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.959845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-57a7b438-3ae9-481c-be75-1b91d32fd72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:33.060722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b438-3ae9-481c-be75-1b91d32fd72e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.131311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b8336-00c9-4fc9-9d22-8cd1aff2ceff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fb6adedea24758bd852be1702cd1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.131925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b8336-00c9-4fc9-9d22-8cd1aff2ceff service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.132204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b8336-00c9-4fc9-9d22-8cd1aff2ceff service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.132470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b8336-00c9-4fc9-9d22-8cd1aff2ceff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.134023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ce1b8336-00c9-4fc9-9d22-8cd1aff2ceff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:33.186245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.240704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b8336-00c9-4fc9-9d22-8cd1aff2ceff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.242121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b8336-00c9-4fc9-9d22-8cd1aff2ceff service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.259781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 572/1150] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:35.474207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f371b4-d0a9-4df4-a303-9b46a76a27c4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.474784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f371b4-d0a9-4df4-a303-9b46a76a27c4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.474784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f371b4-d0a9-4df4-a303-9b46a76a27c4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.476432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 579/1151] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:35.481775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c8e39-21e4-4354-8b67-bf713af56eb4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.482203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c8e39-21e4-4354-8b67-bf713af56eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.482308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c8e39-21e4-4354-8b67-bf713af56eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.548236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-905c8e39-21e4-4354-8b67-bf713af56eb4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:35.549429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-905c8e39-21e4-4354-8b67-bf713af56eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:35.643901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 573/1152] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:35.915558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f371b4-d0a9-4df4-a303-9b46a76a27c4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.917130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f8f371b4-d0a9-4df4-a303-9b46a76a27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:36.040329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f371b4-d0a9-4df4-a303-9b46a76a27c4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:36.087598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:36.131702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006ac02-ca8d-4894-9f80-34565b8a90df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:36.132337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ac02-ca8d-4894-9f80-34565b8a90df admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.132617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ac02-ca8d-4894-9f80-34565b8a90df admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.132888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ac02-ca8d-4894-9f80-34565b8a90df admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.133521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006ac02-ca8d-4894-9f80-34565b8a90df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:36.134621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-f006ac02-ca8d-4894-9f80-34565b8a90df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:23:36.134621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:23:36.134621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:23:36.135749 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006ac02-ca8d-4894-9f80-34565b8a90df admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:36.154303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 580/1153] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:23:38.316991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92b92-08b3-4f42-b26b-d78733daa204 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.317592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92b92-08b3-4f42-b26b-d78733daa204 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.317592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92b92-08b3-4f42-b26b-d78733daa204 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.318871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 574/1154] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:38.324175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c121ef-1325-4583-94ee-09e5af4e5d40 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.324577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c121ef-1325-4583-94ee-09e5af4e5d40 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.324723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c121ef-1325-4583-94ee-09e5af4e5d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.391886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-51c121ef-1325-4583-94ee-09e5af4e5d40 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:38.393079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-51c121ef-1325-4583-94ee-09e5af4e5d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:38.488225 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 581/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:38.777663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa92b92-08b3-4f42-b26b-d78733daa204 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:38.779168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9aa92b92-08b3-4f42-b26b-d78733daa204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:38.789566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:38.923964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa92b92-08b3-4f42-b26b-d78733daa204 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.005355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.037880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8f22-8fa9-446d-b2ae-6d158a9610b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.038442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8f22-8fa9-446d-b2ae-6d158a9610b4 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.038722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8f22-8fa9-446d-b2ae-6d158a9610b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.038993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8f22-8fa9-446d-b2ae-6d158a9610b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.040613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-253a8f22-8fa9-446d-b2ae-6d158a9610b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:39.130253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8f22-8fa9-446d-b2ae-6d158a9610b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.132074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8f22-8fa9-446d-b2ae-6d158a9610b4 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.149910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 575/1156] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:41.463098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa0031-80cd-426a-9c2d-b1b7272ab656 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:41.463669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa0031-80cd-426a-9c2d-b1b7272ab656 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:41.463669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa0031-80cd-426a-9c2d-b1b7272ab656 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:41.465015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 582/1157] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:41.470325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16283b5-ef3a-4414-a588-0f57351ded9a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:41.470734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16283b5-ef3a-4414-a588-0f57351ded9a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:41.470939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16283b5-ef3a-4414-a588-0f57351ded9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:41.536403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b16283b5-ef3a-4414-a588-0f57351ded9a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:41.537593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b16283b5-ef3a-4414-a588-0f57351ded9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:41.583494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:41.633806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 576/1158] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:41.918457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa0031-80cd-426a-9c2d-b1b7272ab656 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:41.920034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f8aa0031-80cd-426a-9c2d-b1b7272ab656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:41.944007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:42.023918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa0031-80cd-426a-9c2d-b1b7272ab656 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:42.094503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed651b-7a24-447f-97b9-e129c1c70ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:42.095102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed651b-7a24-447f-97b9-e129c1c70ceb service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.095382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed651b-7a24-447f-97b9-e129c1c70ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.095650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed651b-7a24-447f-97b9-e129c1c70ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.097758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88ed651b-7a24-447f-97b9-e129c1c70ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:42.169398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:42.203515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed651b-7a24-447f-97b9-e129c1c70ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:42.204972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed651b-7a24-447f-97b9-e129c1c70ceb service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:42.222800 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 583/1159] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:44.412458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3b70-07a1-414f-b5ba-a1cda46885a2 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.413045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3b70-07a1-414f-b5ba-a1cda46885a2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.413045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3b70-07a1-414f-b5ba-a1cda46885a2 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.414416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 577/1160] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:44.419843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15353b8-f343-4f7c-9068-05809685e01e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.420286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15353b8-f343-4f7c-9068-05809685e01e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.420486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15353b8-f343-4f7c-9068-05809685e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.485267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a15353b8-f343-4f7c-9068-05809685e01e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:44.486471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a15353b8-f343-4f7c-9068-05809685e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:44.581942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 584/1161] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:44.888085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dde311-395d-4bcd-9d50-90e51cad5406 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.888359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dde311-395d-4bcd-9d50-90e51cad5406 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.888631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dde311-395d-4bcd-9d50-90e51cad5406 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.889968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 578/1162] 10.222.0.45 () {54 vars in 964 bytes} [Wed Oct 12 12:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:44.896460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb080-6676-4477-a044-984d4affa0ca None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.896749 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb080-6676-4477-a044-984d4affa0ca None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.897027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb080-6676-4477-a044-984d4affa0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.933200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:44.973400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-033cb080-6676-4477-a044-984d4affa0ca None None] MFA Rules not processed for user `319b5538054c49d19ecc0b9c9cfc5b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:44.974588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-033cb080-6676-4477-a044-984d4affa0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:45.049832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 585/1163] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Oct 12 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:45.058776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dde311-395d-4bcd-9d50-90e51cad5406 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:45.060343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-16dde311-395d-4bcd-9d50-90e51cad5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:45.165060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dde311-395d-4bcd-9d50-90e51cad5406 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:45.236648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:45.238157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2886f4-9d06-4701-a6bb-cccbe040abda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:45.238773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2886f4-9d06-4701-a6bb-cccbe040abda service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:45.239262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2886f4-9d06-4701-a6bb-cccbe040abda service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:45.239706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2886f4-9d06-4701-a6bb-cccbe040abda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:45.241528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cc2886f4-9d06-4701-a6bb-cccbe040abda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:45.349695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2886f4-9d06-4701-a6bb-cccbe040abda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:45.351121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2886f4-9d06-4701-a6bb-cccbe040abda service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:45.369908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 579/1164] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:48.072611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a14e-42af-4d3e-a380-22a7529297d8 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.073182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a14e-42af-4d3e-a380-22a7529297d8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.073182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a14e-42af-4d3e-a380-22a7529297d8 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.074498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 586/1165] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:48.079911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605785-4167-4741-8dbd-9da13c02f5a8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.080367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605785-4167-4741-8dbd-9da13c02f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.080475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605785-4167-4741-8dbd-9da13c02f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.145929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-15605785-4167-4741-8dbd-9da13c02f5a8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:48.147142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-15605785-4167-4741-8dbd-9da13c02f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:48.198627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:48.242794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 580/1166] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:48.542220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a14e-42af-4d3e-a380-22a7529297d8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:48.543743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cf52a14e-42af-4d3e-a380-22a7529297d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:48.644401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a14e-42af-4d3e-a380-22a7529297d8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:48.669364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:48.717199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734013da-0baf-4cc6-8228-ab62b92d6f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:48.717797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734013da-0baf-4cc6-8228-ab62b92d6f24 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.718074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734013da-0baf-4cc6-8228-ab62b92d6f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.718341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734013da-0baf-4cc6-8228-ab62b92d6f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.719945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-734013da-0baf-4cc6-8228-ab62b92d6f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:48.826921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734013da-0baf-4cc6-8228-ab62b92d6f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:48.828395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734013da-0baf-4cc6-8228-ab62b92d6f24 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:48.846416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 587/1167] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:23:51.218012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdb4c-27d6-46ba-b3ab-16da68060908 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.218552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdb4c-27d6-46ba-b3ab-16da68060908 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.218552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdb4c-27d6-46ba-b3ab-16da68060908 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.219930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 581/1168] 10.222.0.45 () {54 vars in 927 bytes} [Wed Oct 12 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:51.225601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54682794-3a4d-4f0b-ad06-58df061bb30f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.226012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54682794-3a4d-4f0b-ad06-58df061bb30f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.226143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54682794-3a4d-4f0b-ad06-58df061bb30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.291050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-54682794-3a4d-4f0b-ad06-58df061bb30f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:51.292273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-54682794-3a4d-4f0b-ad06-58df061bb30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:51.295163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:51.388184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 588/1169] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:23:51.676291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fdb4c-27d6-46ba-b3ab-16da68060908 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:51.677873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-051fdb4c-27d6-46ba-b3ab-16da68060908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:51.780133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fdb4c-27d6-46ba-b3ab-16da68060908 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:51.852988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f673-d3d0-4683-8168-552ac9791672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:51.853588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f673-d3d0-4683-8168-552ac9791672 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.853870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f673-d3d0-4683-8168-552ac9791672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.854143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f673-d3d0-4683-8168-552ac9791672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.855729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6529f673-d3d0-4683-8168-552ac9791672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:51.864211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:51.965475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529f673-d3d0-4683-8168-552ac9791672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:51.966915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529f673-d3d0-4683-8168-552ac9791672 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:51.985002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 582/1170] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:24:01.386656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=41 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:01.982760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=50 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:11.081545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:11.082118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:11.082118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:11.155592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:25:11.156812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:11.249487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 589/1171] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:25:11.257273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a6d9-5d17-4c2b-8b77-79a089ca0621 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:11.257783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a6d9-5d17-4c2b-8b77-79a089ca0621 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:11.257888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a6d9-5d17-4c2b-8b77-79a089ca0621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:11.332956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4635a6d9-5d17-4c2b-8b77-79a089ca0621 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:25:11.334092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4635a6d9-5d17-4c2b-8b77-79a089ca0621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:11.429929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 583/1172] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:25:11.434584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:11.435773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:11.447620 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16b8e9-25bf-43dd-ac9c-d9966c9e937a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:11.506683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:11.539555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:11.540201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:11.540484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:11.540753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:11.541384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:25:11.541682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:11.542709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:25:11.542709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:25:11.542709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:25:11.543583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:11.554237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 590/1173] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:25:11.564266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635a6d9-5d17-4c2b-8b77-79a089ca0621 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:11.573869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635a6d9-5d17-4c2b-8b77-79a089ca0621 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:11.635699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:11.668637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:11.669245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:11.669526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:11.669796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:11.670448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:11.671466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:25:11.671466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:25:11.671466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:25:11.672733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:11.727308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 584/1174] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:25:11 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:25:11.731517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:11.733068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:11.767415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744286e-61df-4e6c-bf49-3d226a4777b3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:11.858182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:11.858787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:11.859068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:11.859340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:11.860273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:11.861314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:25:11.861314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:25:11.861314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:25:11.862531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:11.904182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 591/1175] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:25:11 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:25:11.908208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:11.909773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:11.970910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4299-3587-4a23-a412-3c784ddfe648 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:12.054313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:12.066811 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:12.067414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:12.067690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:12.067987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:12.068621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:12.070208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:12.082280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 585/1176] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:25:12.086288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:12.087822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:12.098994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387bef8-1a37-460c-840e-53f193d69bea admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:12.124540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:12.193476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5d19a-dc37-494f-868d-50a675158e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:12.194003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5d19a-dc37-494f-868d-50a675158e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:12.194280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5d19a-dc37-494f-868d-50a675158e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:12.194555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5d19a-dc37-494f-868d-50a675158e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:12.195188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5d19a-dc37-494f-868d-50a675158e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:12.196847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5d19a-dc37-494f-868d-50a675158e10 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:12.209114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 592/1177] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:25:12.213215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:12.214728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:12.248714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdf433-94ff-4556-b366-63dc79bf6f99 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:12.340050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac567dd-d307-499e-958b-16f5ee8e0db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:12.340704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac567dd-d307-499e-958b-16f5ee8e0db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:12.340985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac567dd-d307-499e-958b-16f5ee8e0db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:12.341258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac567dd-d307-499e-958b-16f5ee8e0db6 admin admin] PATH_INFO: `/v3/projects/b9121c51734b4c6ea35d52c5b8f55489/users/e41f819afa5642e6b69f0b5ce6353185/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:12.364318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac567dd-d307-499e-958b-16f5ee8e0db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9121c51734b4c6ea35d52c5b8f55489, user_id=e41f819afa5642e6b69f0b5ce6353185, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:12.366943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac567dd-d307-499e-958b-16f5ee8e0db6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:12.392098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 586/1178] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:25:12 2022] PUT /identity/v3/projects/b9121c51734b4c6ea35d52c5b8f55489/users/e41f819afa5642e6b69f0b5ce6353185/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:25:12.403434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582971ea-72a4-4849-9619-3ab0a2b7fffc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:12.403817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582971ea-72a4-4849-9619-3ab0a2b7fffc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:12.404107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582971ea-72a4-4849-9619-3ab0a2b7fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:12.459920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-582971ea-72a4-4849-9619-3ab0a2b7fffc None None] MFA Rules not processed for user `e41f819afa5642e6b69f0b5ce6353185`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:25:12.461059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-582971ea-72a4-4849-9619-3ab0a2b7fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:12.537536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 593/1179] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:25:12.551082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3801da-a4d2-4333-bb60-0c4a3b568ac7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:12.551370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3801da-a4d2-4333-bb60-0c4a3b568ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:12.551645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3801da-a4d2-4333-bb60-0c4a3b568ac7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:12.553004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 587/1180] 10.222.0.45 () {54 vars in 963 bytes} [Wed Oct 12 12:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:25:12.557830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bc107-fee9-44b1-bb57-527211197054 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:12.558127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bc107-fee9-44b1-bb57-527211197054 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:12.558407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bc107-fee9-44b1-bb57-527211197054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:12.589591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:12.633491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2b5bc107-fee9-44b1-bb57-527211197054 None None] MFA Rules not processed for user `ce79e1215c0345a59146c8bf6fe26cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:25:12.634691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2b5bc107-fee9-44b1-bb57-527211197054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:12.707585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 594/1181] 10.222.0.45 () {58 vars in 1060 bytes} [Wed Oct 12 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:25:12.717653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3801da-a4d2-4333-bb60-0c4a3b568ac7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:12.719093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7d3801da-a4d2-4333-bb60-0c4a3b568ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:12.768300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:12.823306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3801da-a4d2-4333-bb60-0c4a3b568ac7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:12.895843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:12.896454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:12.896735 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:12.897008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:12.898594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:12.997617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:12.998953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:13.002413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:13.017976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 588/1182] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:25:13.064563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ef66-edc1-46fb-8c0f-48d0483e9992 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:13.064854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ef66-edc1-46fb-8c0f-48d0483e9992 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:13.065129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ef66-edc1-46fb-8c0f-48d0483e9992 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:13.066400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 595/1183] 10.222.0.45 () {52 vars in 830 bytes} [Wed Oct 12 12:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:25:13.069959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:13.071161 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:13.167428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149118d-8cae-4da9-94aa-fbabdcafd410 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:13.258844 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:13.259981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:13.260263 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:13.260533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] PATH_INFO: `/v3/users/e41f819afa5642e6b69f0b5ce6353185` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:13.272950 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41f819afa5642e6b69f0b5ce6353185)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:13.273971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:25:13.273971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:25:13.273971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:25:13.275162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:13.284593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:13.339470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41f819afa5642e6b69f0b5ce6353185'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:13.339966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41f819afa5642e6b69f0b5ce6353185'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:13.348737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41f819afa5642e6b69f0b5ce6353185'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:13.349333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41f819afa5642e6b69f0b5ce6353185'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:13.374365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41f819afa5642e6b69f0b5ce6353185'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:13.393593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 589/1184] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:25:13 2022] DELETE /identity/v3/users/e41f819afa5642e6b69f0b5ce6353185 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:25:13.397964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:13.398417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:13.398537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:13.456101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:25:13.457322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:13.531284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:13.544064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 596/1185] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:25:13.554264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:13.555477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:13.655895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d9d0-1452-40f9-b831-6842e1c47f2a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:13.709556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:13.729701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc4e91-a4ec-4359-a28c-47f9dab00c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:13.730311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc4e91-a4ec-4359-a28c-47f9dab00c5d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:13.730585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc4e91-a4ec-4359-a28c-47f9dab00c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:13.730854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc4e91-a4ec-4359-a28c-47f9dab00c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:13.732466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a6fc4e91-a4ec-4359-a28c-47f9dab00c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:13.839876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc4e91-a4ec-4359-a28c-47f9dab00c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:13.841309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc4e91-a4ec-4359-a28c-47f9dab00c5d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:13.859330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 590/1186] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:25:14.187975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:25:14.189219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:25:14.203178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a324bb4-fd51-458f-9a07-d48ce0e5ea5e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:25:14.295721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:25:14.296398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:25:14.296673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:25:14.296940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] PATH_INFO: `/v3/projects/b9121c51734b4c6ea35d52c5b8f55489` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:25:14.307141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9121c51734b4c6ea35d52c5b8f55489)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:25:14.308191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:25:14.308191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:25:14.308191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:25:14.309370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:25:14.365188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9121c51734b4c6ea35d52c5b8f55489', 'request_id': 'req-410293e0-f65a-48e8-b48f-2a301fe36c5c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:14.378280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9121c51734b4c6ea35d52c5b8f55489', 'request_id': 'req-410293e0-f65a-48e8-b48f-2a301fe36c5c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:14.388162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9121c51734b4c6ea35d52c5b8f55489', 'request_id': 'req-410293e0-f65a-48e8-b48f-2a301fe36c5c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:14.411203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] The token cache is being invalidate because project b9121c51734b4c6ea35d52c5b8f55489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:25:14.411896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:14.411996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-410293e0-f65a-48e8-b48f-2a301fe36c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:25:14.413340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 597/1187] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:25:14 2022] DELETE /identity/v3/projects/b9121c51734b4c6ea35d52c5b8f55489 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:25:23.857189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=62 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:24.409101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:48.069644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb57a-c2d0-4b8a-8016-eb0bd9b513ac None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:48.070211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb57a-c2d0-4b8a-8016-eb0bd9b513ac None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:48.070211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb57a-c2d0-4b8a-8016-eb0bd9b513ac None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:48.071534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 591/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:48.076457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6260-bade-4a33-95f5-1c6838e94a27 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:48.076913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6260-bade-4a33-95f5-1c6838e94a27 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:48.077047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6260-bade-4a33-95f5-1c6838e94a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:48.155965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5ccb6260-bade-4a33-95f5-1c6838e94a27 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:48.157177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5ccb6260-bade-4a33-95f5-1c6838e94a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:48.261127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 598/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:26:48.415495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb57a-c2d0-4b8a-8016-eb0bd9b513ac None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:48.417692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-60cfb57a-c2d0-4b8a-8016-eb0bd9b513ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:48.533602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb57a-c2d0-4b8a-8016-eb0bd9b513ac None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:48.539791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de43123-4807-41da-9297-3082bf137614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:48.540413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43123-4807-41da-9297-3082bf137614 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:48.540694 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43123-4807-41da-9297-3082bf137614 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:48.540965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43123-4807-41da-9297-3082bf137614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:48.549350 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43123-4807-41da-9297-3082bf137614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:48.550982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43123-4807-41da-9297-3082bf137614 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:48.560320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 592/1190] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:26:49.515035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98219-9e51-4fd5-8a42-abf35bc8396e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:49.515655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98219-9e51-4fd5-8a42-abf35bc8396e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:49.515655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c98219-9e51-4fd5-8a42-abf35bc8396e None None] PATH_INFO: `/v3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:49.517139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 599/1191] 10.222.0.42 () {54 vars in 925 bytes} [Wed Oct 12 12:26:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:26:49.554273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87660-8816-44f4-85f3-d576bb6f6ae0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:49.554837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87660-8816-44f4-85f3-d576bb6f6ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:49.554837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87660-8816-44f4-85f3-d576bb6f6ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:49.613084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-25b87660-8816-44f4-85f3-d576bb6f6ae0 None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:49.614314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-25b87660-8816-44f4-85f3-d576bb6f6ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:49.637188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ca02-5687-4a97-9094-3026f67385f1 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:49.637477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ca02-5687-4a97-9094-3026f67385f1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:49.637754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ca02-5687-4a97-9094-3026f67385f1 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:49.639129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 600/1192] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:26:49.645308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1e31-7baf-47cf-a50a-b394f39610fc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:49.645597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1e31-7baf-47cf-a50a-b394f39610fc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:49.645875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1e31-7baf-47cf-a50a-b394f39610fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:49.666480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d9ea1e31-7baf-47cf-a50a-b394f39610fc None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:49.667704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d9ea1e31-7baf-47cf-a50a-b394f39610fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:49.675650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 601/1193] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:26:49.686447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:49.692188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 593/1194] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Oct 12 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:26:49.828217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1e31-7baf-47cf-a50a-b394f39610fc None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:49.840422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1e31-7baf-47cf-a50a-b394f39610fc None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:49.845884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313e2a9-d0e4-4202-aa7f-6f43c86559bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:49.846476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313e2a9-d0e4-4202-aa7f-6f43c86559bd service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:49.846752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313e2a9-d0e4-4202-aa7f-6f43c86559bd service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:49.847018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313e2a9-d0e4-4202-aa7f-6f43c86559bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:49.855381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313e2a9-d0e4-4202-aa7f-6f43c86559bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:49.857055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313e2a9-d0e4-4202-aa7f-6f43c86559bd service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:49.867945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 602/1195] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:26:59.693056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:59.862343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=78 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:27:01.319752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2322-b2ab-4aaa-a05c-ba8a3ba1750c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:01.320345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2322-b2ab-4aaa-a05c-ba8a3ba1750c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:01.320345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef2322-b2ab-4aaa-a05c-ba8a3ba1750c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:01.321669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 594/1196] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:27:01.327731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be9b2b-550a-4aa6-a0ff-59072be21450 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:01.328178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be9b2b-550a-4aa6-a0ff-59072be21450 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:01.328345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be9b2b-550a-4aa6-a0ff-59072be21450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:01.348093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e4be9b2b-550a-4aa6-a0ff-59072be21450 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:27:01.349306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e4be9b2b-550a-4aa6-a0ff-59072be21450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:01.357554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 603/1197] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:27:01.511217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2322-b2ab-4aaa-a05c-ba8a3ba1750c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:27:01.528169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef2322-b2ab-4aaa-a05c-ba8a3ba1750c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:27:01.533695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310f1e-672b-419e-b18e-a528e8dc6b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:27:01.534298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310f1e-672b-419e-b18e-a528e8dc6b59 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:01.534582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310f1e-672b-419e-b18e-a528e8dc6b59 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:01.534856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310f1e-672b-419e-b18e-a528e8dc6b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:01.543702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310f1e-672b-419e-b18e-a528e8dc6b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:27:01.545347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310f1e-672b-419e-b18e-a528e8dc6b59 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:27:01.554795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 595/1198] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:27:01.662327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba1ac9-0c0f-4124-9911-c7421e2dc23e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:01.663494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba1ac9-0c0f-4124-9911-c7421e2dc23e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:01.663766 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba1ac9-0c0f-4124-9911-c7421e2dc23e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:01.665176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 604/1199] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 12 12:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:27:01.670454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c7612-a6d2-431f-be9a-7b5a734e42a9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:01.670749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c7612-a6d2-431f-be9a-7b5a734e42a9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:01.671049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c7612-a6d2-431f-be9a-7b5a734e42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:01.691311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6e8c7612-a6d2-431f-be9a-7b5a734e42a9 None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:27:01.692740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6e8c7612-a6d2-431f-be9a-7b5a734e42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:01.701951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 596/1200] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 12 12:27:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:27:01.709541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba1ac9-0c0f-4124-9911-c7421e2dc23e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:27:01.723457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba1ac9-0c0f-4124-9911-c7421e2dc23e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:27:01.728894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2d330-6f30-4447-81af-05daa46e7ac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:27:01.729521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d330-6f30-4447-81af-05daa46e7ac1 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:01.729802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d330-6f30-4447-81af-05daa46e7ac1 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:01.730079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d330-6f30-4447-81af-05daa46e7ac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:01.738844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2d330-6f30-4447-81af-05daa46e7ac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:27:01.740552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2d330-6f30-4447-81af-05daa46e7ac1 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:27:01.750571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 605/1201] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:27:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:27:02.637266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121eef0-5a23-42e5-81cf-1ad04681c4a0 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:02.637841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121eef0-5a23-42e5-81cf-1ad04681c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:02.637841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121eef0-5a23-42e5-81cf-1ad04681c4a0 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:02.639135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 597/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:27:02.645359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3afb5-9d1e-4741-bd94-9410ec4c79eb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:02.645778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3afb5-9d1e-4741-bd94-9410ec4c79eb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:02.645913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3afb5-9d1e-4741-bd94-9410ec4c79eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:02.665736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-65e3afb5-9d1e-4741-bd94-9410ec4c79eb None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:27:02.666926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-65e3afb5-9d1e-4741-bd94-9410ec4c79eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:02.674629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 606/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:27:02.824864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121eef0-5a23-42e5-81cf-1ad04681c4a0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:27:02.839359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121eef0-5a23-42e5-81cf-1ad04681c4a0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:27:02.844669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95b03a-7576-43ba-a06d-7d432814d7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:27:02.845247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b03a-7576-43ba-a06d-7d432814d7bc service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:02.845523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b03a-7576-43ba-a06d-7d432814d7bc service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:02.845790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b03a-7576-43ba-a06d-7d432814d7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:02.854262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95b03a-7576-43ba-a06d-7d432814d7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:27:02.855868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95b03a-7576-43ba-a06d-7d432814d7bc service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:27:02.864903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 598/1204] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:27:06.821805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0957b-2702-4f6a-9559-c4d13d9645a2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:06.822324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0957b-2702-4f6a-9559-c4d13d9645a2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:06.822430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0957b-2702-4f6a-9559-c4d13d9645a2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:06.823734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 607/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:27:06.829086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2596-84b5-411d-b386-8a3cdfffe01e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:06.829530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2596-84b5-411d-b386-8a3cdfffe01e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:06.829642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2596-84b5-411d-b386-8a3cdfffe01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:06.849194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5e0c2596-84b5-411d-b386-8a3cdfffe01e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:27:06.850386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5e0c2596-84b5-411d-b386-8a3cdfffe01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:06.858989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 599/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:27:07.147535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0957b-2702-4f6a-9559-c4d13d9645a2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:27:07.149842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-54c0957b-2702-4f6a-9559-c4d13d9645a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:07.226245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0957b-2702-4f6a-9559-c4d13d9645a2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:27:07.229764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b1511-2970-4ba1-8128-5e927e5447b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:27:07.230358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b1511-2970-4ba1-8128-5e927e5447b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:07.230640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b1511-2970-4ba1-8128-5e927e5447b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:07.230916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b1511-2970-4ba1-8128-5e927e5447b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:07.239635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b1511-2970-4ba1-8128-5e927e5447b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:27:07.241137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b1511-2970-4ba1-8128-5e927e5447b4 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:27:07.250598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 608/1207] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:27:09.386735 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa745cf-14e6-403a-b131-6d8818fdd269 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:09.387291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa745cf-14e6-403a-b131-6d8818fdd269 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:09.387291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa745cf-14e6-403a-b131-6d8818fdd269 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:09.388659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 600/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:27:09.393869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24a93-607e-49cf-a601-5b998d4f2b16 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:09.394322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24a93-607e-49cf-a601-5b998d4f2b16 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:09.394496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24a93-607e-49cf-a601-5b998d4f2b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:09.414086 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-56a24a93-607e-49cf-a601-5b998d4f2b16 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:27:09.415288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-56a24a93-607e-49cf-a601-5b998d4f2b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:09.423010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 609/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:27:09.706728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa745cf-14e6-403a-b131-6d8818fdd269 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:27:09.717825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa745cf-14e6-403a-b131-6d8818fdd269 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:27:09.721286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb875e51-5a02-4599-ad48-bbd9edb3138d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:27:09.721869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875e51-5a02-4599-ad48-bbd9edb3138d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:09.722147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875e51-5a02-4599-ad48-bbd9edb3138d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:09.722413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875e51-5a02-4599-ad48-bbd9edb3138d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:09.731651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb875e51-5a02-4599-ad48-bbd9edb3138d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:27:09.733124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb875e51-5a02-4599-ad48-bbd9edb3138d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:27:09.742192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 601/1210] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:27:13.537931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba51d2-9722-49e2-a32a-80e3b9b6a969 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:13.538505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba51d2-9722-49e2-a32a-80e3b9b6a969 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:13.538505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba51d2-9722-49e2-a32a-80e3b9b6a969 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:13.539880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 610/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:27:13.545203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dbabe-f067-414b-b0ca-e0cedf002438 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:13.545621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dbabe-f067-414b-b0ca-e0cedf002438 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:13.545747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dbabe-f067-414b-b0ca-e0cedf002438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:13.566475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-761dbabe-f067-414b-b0ca-e0cedf002438 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:27:13.567705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-761dbabe-f067-414b-b0ca-e0cedf002438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:13.575991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 602/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:27:13.878575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba51d2-9722-49e2-a32a-80e3b9b6a969 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:27:13.880279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-32ba51d2-9722-49e2-a32a-80e3b9b6a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:13.956641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba51d2-9722-49e2-a32a-80e3b9b6a969 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:27:13.960163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37a20-3a9f-4fde-a880-c648ed49a518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:27:13.960804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37a20-3a9f-4fde-a880-c648ed49a518 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:13.961085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37a20-3a9f-4fde-a880-c648ed49a518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:13.961358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37a20-3a9f-4fde-a880-c648ed49a518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:13.970001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37a20-3a9f-4fde-a880-c648ed49a518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:27:13.971421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37a20-3a9f-4fde-a880-c648ed49a518 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:27:13.981155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 611/1213] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:27:16.122601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dd3de-6871-4137-b79e-a474d37519e1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:16.123205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dd3de-6871-4137-b79e-a474d37519e1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:16.123299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dd3de-6871-4137-b79e-a474d37519e1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:16.124648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 603/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:27:16.129855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bb43-8d00-4e9f-88ab-481307412b50 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:16.130264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bb43-8d00-4e9f-88ab-481307412b50 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:16.130411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bb43-8d00-4e9f-88ab-481307412b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:16.150956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6067bb43-8d00-4e9f-88ab-481307412b50 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:27:16.152189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6067bb43-8d00-4e9f-88ab-481307412b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:16.159972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 612/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:27:16.457066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dd3de-6871-4137-b79e-a474d37519e1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:27:16.458751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5e7dd3de-6871-4137-b79e-a474d37519e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:27:16.471704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dd3de-6871-4137-b79e-a474d37519e1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:27:16.475388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688dd24-ad4b-47b5-82f5-f90c36239f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:27:16.476025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688dd24-ad4b-47b5-82f5-f90c36239f33 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:27:16.476363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688dd24-ad4b-47b5-82f5-f90c36239f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:27:16.476640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688dd24-ad4b-47b5-82f5-f90c36239f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:27:16.485341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688dd24-ad4b-47b5-82f5-f90c36239f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:27:16.486807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688dd24-ad4b-47b5-82f5-f90c36239f33 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:27:16.496481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 604/1216] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:27:26.145514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:27:26.491816 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=33 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:43.823226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab595-8c81-49b7-bb7d-4dbf79008edb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:43.824348 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab595-8c81-49b7-bb7d-4dbf79008edb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:43.824857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab595-8c81-49b7-bb7d-4dbf79008edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:43.849222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1c9ab595-8c81-49b7-bb7d-4dbf79008edb None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:43.850462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1c9ab595-8c81-49b7-bb7d-4dbf79008edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:43.864048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 613/1217] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:28:43.873984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc564-550d-4c05-9e33-21f941a3378b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:43.874990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc564-550d-4c05-9e33-21f941a3378b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:43.876063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc564-550d-4c05-9e33-21f941a3378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:43.911825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7ebbc564-550d-4c05-9e33-21f941a3378b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:43.914281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7ebbc564-550d-4c05-9e33-21f941a3378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:43.924186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 605/1218] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:28:43.929142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab595-8c81-49b7-bb7d-4dbf79008edb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:43.932063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4b72-8ad0-4817-8398-2ced8666a3f1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:43.932595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4b72-8ad0-4817-8398-2ced8666a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:43.933690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4b72-8ad0-4817-8398-2ced8666a3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:43.950649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab595-8c81-49b7-bb7d-4dbf79008edb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:43.956220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7f9d4b72-8ad0-4817-8398-2ced8666a3f1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:43.957760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7f9d4b72-8ad0-4817-8398-2ced8666a3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:43.963853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3466-af9a-450c-b28b-e325816aed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:43.963853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3466-af9a-450c-b28b-e325816aed9c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:43.963853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3466-af9a-450c-b28b-e325816aed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:43.963853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3466-af9a-450c-b28b-e325816aed9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:43.964404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3466-af9a-450c-b28b-e325816aed9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:43.964404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3466-af9a-450c-b28b-e325816aed9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:43.964771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3466-af9a-450c-b28b-e325816aed9c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:43.972620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 606/1219] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:28:43.974362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312029e7-907f-4b07-b3f3-ede90e30a927 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:43.974893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312029e7-907f-4b07-b3f3-ede90e30a927 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:43.975938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312029e7-907f-4b07-b3f3-ede90e30a927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:43.994111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 614/1220] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:43.995480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e04f2-a67d-4e6d-8c6f-699103abf7b2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:43.995778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e04f2-a67d-4e6d-8c6f-699103abf7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:43.996083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e04f2-a67d-4e6d-8c6f-699103abf7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.012001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-312029e7-907f-4b07-b3f3-ede90e30a927 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.013592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-312029e7-907f-4b07-b3f3-ede90e30a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.022765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 607/1221] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.024347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7b2ce-57de-4479-b892-a0e95237aa9d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.024856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7b2ce-57de-4479-b892-a0e95237aa9d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.025340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7b2ce-57de-4479-b892-a0e95237aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.029181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-842e04f2-a67d-4e6d-8c6f-699103abf7b2 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.030469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-842e04f2-a67d-4e6d-8c6f-699103abf7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.043391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 615/1222] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.046707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e04f2-a67d-4e6d-8c6f-699103abf7b2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.055916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fdd7b2ce-57de-4479-b892-a0e95237aa9d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.057532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fdd7b2ce-57de-4479-b892-a0e95237aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.057738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e04f2-a67d-4e6d-8c6f-699103abf7b2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.062947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f346f-0fd5-4eba-8d12-8ecb938c340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.063559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f346f-0fd5-4eba-8d12-8ecb938c340b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.063952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f346f-0fd5-4eba-8d12-8ecb938c340b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.064232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f346f-0fd5-4eba-8d12-8ecb938c340b admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.065004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f346f-0fd5-4eba-8d12-8ecb938c340b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.066033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-798f346f-0fd5-4eba-8d12-8ecb938c340b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:28:44.066033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:28:44.066033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:28:44.067821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f346f-0fd5-4eba-8d12-8ecb938c340b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.070092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 608/1223] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.071529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ec80-0037-464b-a471-4a8949d96604 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.072059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ec80-0037-464b-a471-4a8949d96604 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.072568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ec80-0037-464b-a471-4a8949d96604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.113745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2a78ec80-0037-464b-a471-4a8949d96604 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.116132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2a78ec80-0037-464b-a471-4a8949d96604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.132708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 609/1224] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.134860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020671f-cb58-4009-a12d-5bac601629a4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.136623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 616/1225] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.138081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fead9f-6ece-4916-ad1a-54b2b832499d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.138594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fead9f-6ece-4916-ad1a-54b2b832499d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.139082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fead9f-6ece-4916-ad1a-54b2b832499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.144256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020671f-cb58-4009-a12d-5bac601629a4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.146980 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020671f-cb58-4009-a12d-5bac601629a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.174582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a9fead9f-6ece-4916-ad1a-54b2b832499d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.175870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b020671f-cb58-4009-a12d-5bac601629a4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.176017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a9fead9f-6ece-4916-ad1a-54b2b832499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.177404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b020671f-cb58-4009-a12d-5bac601629a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.241372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 617/1226] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.242140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fead9f-6ece-4916-ad1a-54b2b832499d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.246789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 610/1227] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.248166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d580a-d03f-445d-a69b-8d3f296ce64a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.248316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d580a-d03f-445d-a69b-8d3f296ce64a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.248591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d580a-d03f-445d-a69b-8d3f296ce64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.252382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fead9f-6ece-4916-ad1a-54b2b832499d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.257172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.257760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.258040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.258433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.259088 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:44.259391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.261005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.268863 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-202d580a-d03f-445d-a69b-8d3f296ce64a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.270040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-202d580a-d03f-445d-a69b-8d3f296ce64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.272937 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 618/1228] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:44.273710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.278848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 611/1229] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.280856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04ff4-7b6a-4192-bae7-8a4f8c335884 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.281145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04ff4-7b6a-4192-bae7-8a4f8c335884 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.281446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe04ff4-7b6a-4192-bae7-8a4f8c335884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.283149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92847-04e2-47f9-9f4c-00dc4b294d37 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.288731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9020f-4982-4901-9c9d-cd226f004338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.289328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9020f-4982-4901-9c9d-cd226f004338 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.289613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9020f-4982-4901-9c9d-cd226f004338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.289888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9020f-4982-4901-9c9d-cd226f004338 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.291219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9020f-4982-4901-9c9d-cd226f004338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.292760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9020f-4982-4901-9c9d-cd226f004338 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.301327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3fe04ff4-7b6a-4192-bae7-8a4f8c335884 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.302504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3fe04ff4-7b6a-4192-bae7-8a4f8c335884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.312002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 612/1230] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.315521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 619/1231] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.319586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5334-e14b-4dde-8450-93419cae1e64 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.319901 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5334-e14b-4dde-8450-93419cae1e64 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.320176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5334-e14b-4dde-8450-93419cae1e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.321237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cb2d0-14b1-4f77-85a9-99e3fd55f129 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.321533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cb2d0-14b1-4f77-85a9-99e3fd55f129 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.321814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cb2d0-14b1-4f77-85a9-99e3fd55f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.339579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-270b5334-e14b-4dde-8450-93419cae1e64 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.340805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-270b5334-e14b-4dde-8450-93419cae1e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.341849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-659cb2d0-14b1-4f77-85a9-99e3fd55f129 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.343020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-659cb2d0-14b1-4f77-85a9-99e3fd55f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.349107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 620/1232] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.349870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b5334-e14b-4dde-8450-93419cae1e64 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.351024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 613/1233] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.352824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cb2d0-14b1-4f77-85a9-99e3fd55f129 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.361868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b5334-e14b-4dde-8450-93419cae1e64 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.363209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cb2d0-14b1-4f77-85a9-99e3fd55f129 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.366663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.367316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.367598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.367734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.367962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.368297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.368547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:44.368656 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.368837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.368953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.369484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:44.369789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.370423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.370800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:28:44.370800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:28:44.370800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:28:44.371666 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.383012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 621/1234] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:44.383836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.391308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 614/1235] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:44.391308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.399347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df159596-32eb-4ab7-8593-5d92d373fd6b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.400229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e2952-1ccb-4629-a0bb-94b4ee44ad3f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.404097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.404775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.404940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83795a8-d563-4cf0-8cf2-d278eee83329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.405058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.405350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.405626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83795a8-d563-4cf0-8cf2-d278eee83329 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.405914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83795a8-d563-4cf0-8cf2-d278eee83329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.406034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:44.406223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83795a8-d563-4cf0-8cf2-d278eee83329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.406335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.407907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83795a8-d563-4cf0-8cf2-d278eee83329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.408031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.409800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83795a8-d563-4cf0-8cf2-d278eee83329 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.420085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 622/1236] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:44.420886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.431049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066237d-1096-4ee3-acc1-e96e91aa1b87 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.435741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4870c8-4264-4a1c-91d1-876c13e15b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.436349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4870c8-4264-4a1c-91d1-876c13e15b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.436627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4870c8-4264-4a1c-91d1-876c13e15b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.436900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4870c8-4264-4a1c-91d1-876c13e15b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.437527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4870c8-4264-4a1c-91d1-876c13e15b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.441526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 615/1237] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.441683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4870c8-4264-4a1c-91d1-876c13e15b9f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.441769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda0759-88c5-4cb6-8b35-fb0f14af943b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.441769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda0759-88c5-4cb6-8b35-fb0f14af943b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.441769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda0759-88c5-4cb6-8b35-fb0f14af943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.452745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 623/1238] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:44.452745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd3818-74b6-4918-ab4b-3d8d76b61e64 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.452745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd3818-74b6-4918-ab4b-3d8d76b61e64 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.452745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd3818-74b6-4918-ab4b-3d8d76b61e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.461084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3bda0759-88c5-4cb6-8b35-fb0f14af943b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.462281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3bda0759-88c5-4cb6-8b35-fb0f14af943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.469865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9ffd3818-74b6-4918-ab4b-3d8d76b61e64 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.471018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9ffd3818-74b6-4918-ab4b-3d8d76b61e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.495002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:44.522431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 616/1239] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.523709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa96ed-bbd0-4438-a4de-0baff2ae362d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.524029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa96ed-bbd0-4438-a4de-0baff2ae362d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.524299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa96ed-bbd0-4438-a4de-0baff2ae362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.532445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 624/1240] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.533296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd3818-74b6-4918-ab4b-3d8d76b61e64 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.542638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd3818-74b6-4918-ab4b-3d8d76b61e64 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.543484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c4fa96ed-bbd0-4438-a4de-0baff2ae362d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:44.544721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c4fa96ed-bbd0-4438-a4de-0baff2ae362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:44.547838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.548420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.548702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.548980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.549732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.551641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.553402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 617/1241] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:44.554205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa96ed-bbd0-4438-a4de-0baff2ae362d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.564164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa96ed-bbd0-4438-a4de-0baff2ae362d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.568939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.569565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.569851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.570124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.570901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.573088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.577952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:44.581285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 625/1242] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.582154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.602257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 618/1243] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.603046 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.649144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796d052-63c8-473c-b362-8a101a749c59 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.663890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804bb29-2889-4996-a7db-2a81657199f2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.668387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.668988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.669266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.669536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.670149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.671160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:28:44.671160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:28:44.671160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:28:44.672886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.694404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 619/1244] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.695210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.706376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64be31c-2561-4b73-8b3b-f023e944169c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.706949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.707556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.707864 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.708140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.708783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.710680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.710875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.711448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.711722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.712035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.712650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.714202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.724406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 620/1245] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:44.725183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.734543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d409-23f7-47c6-8651-58796ab4199f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.739902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.740472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.740746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.741014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.741644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:44.741941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.743491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.743608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 626/1246] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.744431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.756571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 621/1247] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:44.757104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.766593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978267-78d5-486c-bca9-102d6ccfccc4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.792843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:44.813402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c4306-a98e-43d7-9d22-830af271fd0f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.817957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.818557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.818834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.819102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.819743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:44.820074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.821670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.824011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.824638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.825047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.825329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.825975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:44.826282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.827891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.833188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 627/1248] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:44.834384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.845511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45642d65-530c-4d2c-84e2-b5599b41eb87 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.846986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 622/1249] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:44.847830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.850356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.851139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.851426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.851697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.852350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.854416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.858988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2bb13-62ae-4832-87e9-b863023000da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.864136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.864718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.865295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.865295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.865861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.867750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.879462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 628/1250] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.879462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.888406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03654f3-8650-4e73-b3bc-ae6b1de4445d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.890179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 623/1251] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.890969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.894752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.895345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.895634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.895934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.896570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.898160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.900447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d3498-72d5-4801-86c7-ad88622dda99 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.904990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.905634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.905914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.906317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] PATH_INFO: `/v3/projects/1e85d8f1243d4e2db89b8e812435dadf/users/5cccd636e68947338c11c9e29292289c/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.909564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 629/1252] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:44.910333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.919588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a907d3-8e88-458d-ac49-4b4a0d11c08e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:44.921658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e85d8f1243d4e2db89b8e812435dadf, user_id=5cccd636e68947338c11c9e29292289c, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.924885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.925018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:44.925560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:44.925851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:44.926103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:44.926795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:44.928694 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:44.938028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 624/1253] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:44 2022] PUT /identity/v3/projects/1e85d8f1243d4e2db89b8e812435dadf/users/5cccd636e68947338c11c9e29292289c/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:44.938799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.943180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:44.962312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 630/1254] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:44.962312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:44.969722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9613a-b41b-453f-8ca4-d2d015a12e8e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.006801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea356-6a67-4a39-943e-9825f31e52d6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.011516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.012193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.012515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.012762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.013396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.015300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.026278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.026898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.027179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.027457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.028175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.030257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.043770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 625/1255] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.048401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.063711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 631/1256] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:44 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.063711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.115193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea010c1-4494-41a3-ac6c-f86a8acf8e51 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.120398 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.121029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.121216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.121495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.122130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.123353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c5dd-723a-4547-af9c-8b2a99c094c5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.124075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.128061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.128668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.128951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.129229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.129904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.131755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.142160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 632/1257] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.146278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.151705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 626/1258] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.152671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.159379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd21df-f219-4ded-b7df-d7b592739918 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.164052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:45.218312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f662-ebfa-4502-b1ce-b61e76ded780 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.221769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd1212-d7ee-408c-a0a0-7e6aea9b60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.222407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd1212-d7ee-408c-a0a0-7e6aea9b60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.222688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd1212-d7ee-408c-a0a0-7e6aea9b60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.223045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd1212-d7ee-408c-a0a0-7e6aea9b60a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.223562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.223687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd1212-d7ee-408c-a0a0-7e6aea9b60a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.224200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.224480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.224747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.225385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.225579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd1212-d7ee-408c-a0a0-7e6aea9b60a9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.226979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.235073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 633/1259] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.236300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5e23c-3d3b-4e49-89bd-3fd6a88411ae None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.236588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5e23c-3d3b-4e49-89bd-3fd6a88411ae None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.236888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5e23c-3d3b-4e49-89bd-3fd6a88411ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.240084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 627/1260] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.240911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.250352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f4e5-6b95-44b6-a040-555c642d20d1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.255013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.255599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.256181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.256474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.257149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.258681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.260884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:45.264045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d3d5e23c-3d3b-4e49-89bd-3fd6a88411ae None None] MFA Rules not processed for user `5cccd636e68947338c11c9e29292289c`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:45.265304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d3d5e23c-3d3b-4e49-89bd-3fd6a88411ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:45.273752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 628/1261] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.273752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.281094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0254-fd30-45b0-98d3-40217ffae067 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.286747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.287348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.287631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.287944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.288562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.290470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.314006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 629/1262] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.314783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.323997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445e15e-0ddd-4d5a-9814-a615af477847 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.329270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.329851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.330130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.330402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.331009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.332488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 634/1263] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:45.332936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.333330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5e23c-3d3b-4e49-89bd-3fd6a88411ae None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.345263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5e23c-3d3b-4e49-89bd-3fd6a88411ae None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.350650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.351251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.351561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.351828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.352478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.354085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.357513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 630/1264] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.357513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.364780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26884e4f-bc30-461c-b83f-6182e725d50b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.366571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 635/1265] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.367261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.372649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.373238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.373516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.373786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.374443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.376417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.378830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc045f0f-bf74-4b57-bbf2-351f89588557 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.383767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.384332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.384567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.384887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.385750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.387475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.398997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 636/1266] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.399772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.404185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 631/1267] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/users => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.404185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.409974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ed0b-8c98-4177-a90b-29f5f487ea4d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.414561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.415192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.415475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.415638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4dfb2-d1bd-4d42-b0ba-79de1616b667 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.415823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] PATH_INFO: `/v3/projects/71c102fa939940e09cd0313c7eb543f6/users/f83067d716e74d69bdffadb7e6c2ff6a/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.420240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.420849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.421129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.421395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.422029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.423612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.430113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c102fa939940e09cd0313c7eb543f6, user_id=f83067d716e74d69bdffadb7e6c2ff6a, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.432799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.433719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 632/1268] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.434497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.444204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b010-4fe1-4f43-8399-3c11bb3c94a9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.446528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 637/1269] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:45 2022] PUT /identity/v3/projects/71c102fa939940e09cd0313c7eb543f6/users/f83067d716e74d69bdffadb7e6c2ff6a/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:45.447394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.496959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:45.501471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.502083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.502438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.502757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.503567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.505224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.511837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c16ce-9d56-47cd-bc87-9c0e0f0c66e0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.515069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 633/1270] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.515879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.519398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.520033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.520315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.520586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.521527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.524320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.526295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e4832-0cb0-4f27-9e12-994605a418f1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.531340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.531956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.532237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.532508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.533144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.534701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.545402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 634/1271] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.546165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.551185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 638/1272] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.552273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.555884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999ed2-8ba8-43fa-9f45-59c7302590b8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.611144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.611815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.612097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.612374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] PATH_INFO: `/v3/projects/a6c5a27a7e4e4f7b83eb192cef4a9602/users/e4c4803ca1e0401f92dde6cc91153c5a/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.615943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cd58-03f9-4cd6-9d3d-80a9d0b8823d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.626949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c5a27a7e4e4f7b83eb192cef4a9602, user_id=e4c4803ca1e0401f92dde6cc91153c5a, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.627244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.627925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.628208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.628481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] PATH_INFO: `/v3/projects/f150add4b1944461bac19c65b151d8c9/users/c5573444a7e74d738675c5f4d94a84be/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.629587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.645465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f150add4b1944461bac19c65b151d8c9, user_id=c5573444a7e74d738675c5f4d94a84be, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.645683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 635/1273] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:45 2022] PUT /identity/v3/projects/a6c5a27a7e4e4f7b83eb192cef4a9602/users/e4c4803ca1e0401f92dde6cc91153c5a/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:45.646423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.648289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.655307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:45.663420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 639/1274] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:45 2022] PUT /identity/v3/projects/f150add4b1944461bac19c65b151d8c9/users/c5573444a7e74d738675c5f4d94a84be/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:45.664264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.716587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad6ef8-15bf-4977-93d7-b3550437dae6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.731004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e5d8-e0a9-4089-b087-d4ebb08b5d09 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.735624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8920c-0c23-414e-b0ef-fe15ef3cb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.736312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8920c-0c23-414e-b0ef-fe15ef3cb960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.736593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8920c-0c23-414e-b0ef-fe15ef3cb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.736866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8920c-0c23-414e-b0ef-fe15ef3cb960 admin admin] PATH_INFO: `/v3/projects/1ef2e209a20b454f89b5a6e1193fe45b/users/25492b6965e3422da9e28309b1b8347f/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.751111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8920c-0c23-414e-b0ef-fe15ef3cb960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef2e209a20b454f89b5a6e1193fe45b, user_id=25492b6965e3422da9e28309b1b8347f, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.753748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8920c-0c23-414e-b0ef-fe15ef3cb960 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.773258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 640/1275] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:45 2022] PUT /identity/v3/projects/1ef2e209a20b454f89b5a6e1193fe45b/users/25492b6965e3422da9e28309b1b8347f/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:45.773258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b18c-3281-407b-9400-60e7474a5e7a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.773258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b18c-3281-407b-9400-60e7474a5e7a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.773258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b18c-3281-407b-9400-60e7474a5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.777417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.778028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.778309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.778581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.779229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.780880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.791326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 636/1276] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.792176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.795627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-64c2b18c-3281-407b-9400-60e7474a5e7a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:45.796876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-64c2b18c-3281-407b-9400-60e7474a5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:45.801449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be6009-5eda-4434-a47e-d594c7e1086b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.831142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:45.857534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.858176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.858320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 641/1277] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:45.858773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.858773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.859232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b18c-3281-407b-9400-60e7474a5e7a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.859333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.861681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.869185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b18c-3281-407b-9400-60e7474a5e7a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.873165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 637/1278] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.874103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:45.877472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed799d86-8358-49d7-bfa0-49a37f160544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.878069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799d86-8358-49d7-bfa0-49a37f160544 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.878352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799d86-8358-49d7-bfa0-49a37f160544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.878622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799d86-8358-49d7-bfa0-49a37f160544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.879257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed799d86-8358-49d7-bfa0-49a37f160544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.881139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed799d86-8358-49d7-bfa0-49a37f160544 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.884669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f37bf-979a-44b4-8e7d-0436c50e81d7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:45.889596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373cb70-9c79-4d80-b7d4-b6377ebe6140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:45.890208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cb70-9c79-4d80-b7d4-b6377ebe6140 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.890743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cb70-9c79-4d80-b7d4-b6377ebe6140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.890743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cb70-9c79-4d80-b7d4-b6377ebe6140 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.891024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 642/1279] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:45.892357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2347cb2-aca1-4e3f-8f62-b5ae622de95c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.892641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2347cb2-aca1-4e3f-8f62-b5ae622de95c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.892912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2347cb2-aca1-4e3f-8f62-b5ae622de95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.894540 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373cb70-9c79-4d80-b7d4-b6377ebe6140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:45.896488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373cb70-9c79-4d80-b7d4-b6377ebe6140 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:45.917823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 638/1280] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:45.919056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26512-f8bf-41b8-9959-7c28f2cbce9b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.919343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26512-f8bf-41b8-9959-7c28f2cbce9b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.919637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26512-f8bf-41b8-9959-7c28f2cbce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:45.923040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e2347cb2-aca1-4e3f-8f62-b5ae622de95c None None] MFA Rules not processed for user `e4c4803ca1e0401f92dde6cc91153c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:45.924265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e2347cb2-aca1-4e3f-8f62-b5ae622de95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:45.948227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-08b26512-f8bf-41b8-9959-7c28f2cbce9b None None] MFA Rules not processed for user `c5573444a7e74d738675c5f4d94a84be`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:45.949446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-08b26512-f8bf-41b8-9959-7c28f2cbce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:45.963305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:45.990556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 643/1281] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:45.995195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d28f-a87a-4671-875b-2f5761d1eacd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:45.995195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d28f-a87a-4671-875b-2f5761d1eacd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:45.995195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d28f-a87a-4671-875b-2f5761d1eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.013791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c5c5d28f-a87a-4671-875b-2f5761d1eacd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:46.014981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c5c5d28f-a87a-4671-875b-2f5761d1eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:46.026530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 644/1282] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:46.026530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d28f-a87a-4671-875b-2f5761d1eacd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.034573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 639/1283] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:46.035734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b26512-f8bf-41b8-9959-7c28f2cbce9b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.037699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d28f-a87a-4671-875b-2f5761d1eacd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.042805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.043413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.043690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.044003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.044669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.046287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.056925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 645/1284] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:46.060891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.071573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721e96-c450-41ea-bdd8-ba119f033a5d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.076175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.076788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.077096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.077373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] PATH_INFO: `/v3/projects/c4e89ec199394cfb85d8ff18fa10f37a/users/ca414f641d5946c1ba498ddeaf8cc25d/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.090550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b26512-f8bf-41b8-9959-7c28f2cbce9b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.091661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e89ec199394cfb85d8ff18fa10f37a, user_id=ca414f641d5946c1ba498ddeaf8cc25d, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.094253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.094395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.094887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.095220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.095497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.105138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.106570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.107335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 646/1285] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:46 2022] PUT /identity/v3/projects/c4e89ec199394cfb85d8ff18fa10f37a/users/ca414f641d5946c1ba498ddeaf8cc25d/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:46.108412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.117363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 640/1286] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:46.118413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.127948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79ff52-421c-408a-a3f8-d8f989e4e6f4 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.178723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba2260-005b-44ae-9546-a312ffe26816 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.183923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.184583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.184866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.185152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] PATH_INFO: `/v3/projects/84e04cf22f28464da2211cd12bdfcbe1/users/89ead5fb644948c5b03f11ac7a1d045d/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.197524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bba9c4-7c46-4c7e-b62f-2f3f37d43a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.198197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bba9c4-7c46-4c7e-b62f-2f3f37d43a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.198571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bba9c4-7c46-4c7e-b62f-2f3f37d43a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.198916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bba9c4-7c46-4c7e-b62f-2f3f37d43a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.199734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bba9c4-7c46-4c7e-b62f-2f3f37d43a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.201780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bba9c4-7c46-4c7e-b62f-2f3f37d43a4f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.201990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e04cf22f28464da2211cd12bdfcbe1, user_id=89ead5fb644948c5b03f11ac7a1d045d, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.204742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.214935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:46.215139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 641/1287] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:46.216443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540e5d-f49e-4dd6-9198-4d383de981a1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.216801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540e5d-f49e-4dd6-9198-4d383de981a1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.217173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540e5d-f49e-4dd6-9198-4d383de981a1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.218535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 642/1288] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 12 12:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:28:46.222697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 647/1289] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:46 2022] PUT /identity/v3/projects/84e04cf22f28464da2211cd12bdfcbe1/users/89ead5fb644948c5b03f11ac7a1d045d/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:46.223714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.224586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b540e5d-f49e-4dd6-9198-4d383de981a1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.294583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b540e5d-f49e-4dd6-9198-4d383de981a1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.298984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.299625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.299935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.300211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.304851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee6131-b3f5-4993-a549-2c28faa48fee admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.308438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:46.310216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f24ed-e91e-451c-af72-02c587a5c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.310915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.311041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f24ed-e91e-451c-af72-02c587a5c623 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.311250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f24ed-e91e-451c-af72-02c587a5c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.311543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f24ed-e91e-451c-af72-02c587a5c623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.312182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f24ed-e91e-451c-af72-02c587a5c623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.313386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.314427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f24ed-e91e-451c-af72-02c587a5c623 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.324461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 643/1290] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:46.325228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.334657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc0284-50a4-48eb-bc0e-11b5fd748382 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.339660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.340613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.340968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.341312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] PATH_INFO: `/v3/projects/0063985e4e814f4389d1fb2cc02fd303/users/4df16c231a164d75a9ad8dbbe09d9380/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.345186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 648/1291] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:46 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:46.346531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164049-0692-4f20-8d1c-b28fc1ef2872 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.346835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164049-0692-4f20-8d1c-b28fc1ef2872 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.347104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164049-0692-4f20-8d1c-b28fc1ef2872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.362822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0063985e4e814f4389d1fb2cc02fd303, user_id=4df16c231a164d75a9ad8dbbe09d9380, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.365747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.377644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-04164049-0692-4f20-8d1c-b28fc1ef2872 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:46.378983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-04164049-0692-4f20-8d1c-b28fc1ef2872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:46.382300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 644/1292] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:46 2022] PUT /identity/v3/projects/0063985e4e814f4389d1fb2cc02fd303/users/4df16c231a164d75a9ad8dbbe09d9380/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:46.383011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.474363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb719b2-e232-40ff-81bf-8248b1d42d55 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.478511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 649/1293] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:46.480328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01528-dde6-4796-b7ce-ed18aed16a16 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.480609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01528-dde6-4796-b7ce-ed18aed16a16 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.480941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01528-dde6-4796-b7ce-ed18aed16a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.481935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970352dc-e6f9-4bea-a43c-f2a4b6cd1007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.482867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970352dc-e6f9-4bea-a43c-f2a4b6cd1007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.483337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970352dc-e6f9-4bea-a43c-f2a4b6cd1007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.483901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970352dc-e6f9-4bea-a43c-f2a4b6cd1007 admin admin] PATH_INFO: `/v3/projects/d1790dd68b4e4f699a2b18d021d23bb5/users/d619ccc0ae2345879a5a6ae84732d20a/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.506468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970352dc-e6f9-4bea-a43c-f2a4b6cd1007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1790dd68b4e4f699a2b18d021d23bb5, user_id=d619ccc0ae2345879a5a6ae84732d20a, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.509812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970352dc-e6f9-4bea-a43c-f2a4b6cd1007 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.534072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 645/1294] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:46 2022] PUT /identity/v3/projects/d1790dd68b4e4f699a2b18d021d23bb5/users/d619ccc0ae2345879a5a6ae84732d20a/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:46.537721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42383a2-a03f-4222-9079-1e4b6a4e6392 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.538678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42383a2-a03f-4222-9079-1e4b6a4e6392 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.539643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42383a2-a03f-4222-9079-1e4b6a4e6392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.573828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a8d01528-dde6-4796-b7ce-ed18aed16a16 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:46.578367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a8d01528-dde6-4796-b7ce-ed18aed16a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:46.609590 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d42383a2-a03f-4222-9079-1e4b6a4e6392 None None] MFA Rules not processed for user `89ead5fb644948c5b03f11ac7a1d045d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:46.615881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d42383a2-a03f-4222-9079-1e4b6a4e6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:46.714251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 650/1295] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 12 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:46.727285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d01528-dde6-4796-b7ce-ed18aed16a16 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.730782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 646/1296] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:46.732738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33481de6-b1e0-43fa-b5d9-f7ab09eeb66a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.733029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33481de6-b1e0-43fa-b5d9-f7ab09eeb66a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.733301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33481de6-b1e0-43fa-b5d9-f7ab09eeb66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.740783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:46.781145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-33481de6-b1e0-43fa-b5d9-f7ab09eeb66a None None] MFA Rules not processed for user `4df16c231a164d75a9ad8dbbe09d9380`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:46.784073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-33481de6-b1e0-43fa-b5d9-f7ab09eeb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:46.833408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d01528-dde6-4796-b7ce-ed18aed16a16 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.834092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:46.839665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.840578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.840695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.841333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.841979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.843948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.874865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 651/1297] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:46 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:46.874865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.884543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 647/1298] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:46.886112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33481de6-b1e0-43fa-b5d9-f7ab09eeb66a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.929097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33481de6-b1e0-43fa-b5d9-f7ab09eeb66a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.940543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.941450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.941739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.944398 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.945099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.948931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:46.960576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94327-7d94-496a-ab18-37c4fe12cfee admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:46.965831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:46.972192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:46.972723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:46.973283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:46.985586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 648/1299] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:46.986554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:46.991156 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:46.993267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.015428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706f171-fd73-4593-bb08-112c3bb3c1c3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.018157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 652/1300] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:47.019300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.033107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a02098-238d-4d59-ad8d-65e12596781e service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.035597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.036372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.036660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.036926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.043768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.044807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.045170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.046084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.047189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.049479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.106936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 653/1301] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:47 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:47.106936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.153320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.156189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.177716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 649/1302] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:47.179246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.199368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee9ef-50b6-4a8e-8dc6-c702a32c912b service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.250150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661884-d0a9-460e-9e0e-a5b8a301df8f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.262486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.264635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.265056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.265401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.267556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.270706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.297883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 654/1303] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:47.317326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.318142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.318538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.318933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.319635 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.319767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.321932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.342842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a0c0-77e3-4b7f-9b7b-f3ba4324e6e3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.358133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.359119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.362590 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.363131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] PATH_INFO: `/v3/projects/d1790dd68b4e4f699a2b18d021d23bb5/users/d619ccc0ae2345879a5a6ae84732d20a/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.365641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 650/1304] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:47 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:47.366558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1790dd68b4e4f699a2b18d021d23bb5, user_id=d619ccc0ae2345879a5a6ae84732d20a, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.367399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.373622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.391384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:47.412146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 655/1305] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:47 2022] PUT /identity/v3/projects/d1790dd68b4e4f699a2b18d021d23bb5/users/d619ccc0ae2345879a5a6ae84732d20a/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:47.412146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.509374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:47.541787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c8df-4674-4378-8f9c-deef9da0341a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.613606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabca89-a416-49cd-b7e1-feeabc3f8237 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.627853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5e2cb-3b1f-4ee4-83f4-fe402ff43ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.628682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e2cb-3b1f-4ee4-83f4-fe402ff43ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.629032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e2cb-3b1f-4ee4-83f4-fe402ff43ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.629371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e2cb-3b1f-4ee4-83f4-fe402ff43ba2 admin admin] PATH_INFO: `/v3/projects/4d0ac65dd68e4b3ca92a0c81e486dc1e/users/08fd2e8dd3b0423ab11bf203e9ebf5d8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.650120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.650978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.651119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.651347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.654518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.656534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.670607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5e2cb-3b1f-4ee4-83f4-fe402ff43ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0ac65dd68e4b3ca92a0c81e486dc1e, user_id=08fd2e8dd3b0423ab11bf203e9ebf5d8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.674486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5e2cb-3b1f-4ee4-83f4-fe402ff43ba2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.682769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 651/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:47 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:47.684148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.700129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de125b-2f84-4307-9142-f0aff9244b1f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.704658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 656/1307] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:47 2022] PUT /identity/v3/projects/4d0ac65dd68e4b3ca92a0c81e486dc1e/users/08fd2e8dd3b0423ab11bf203e9ebf5d8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:47.706184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dde880-e4e1-4aec-baa4-12319eb5ce03 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.706607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dde880-e4e1-4aec-baa4-12319eb5ce03 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.706983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dde880-e4e1-4aec-baa4-12319eb5ce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.740421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f4dde880-e4e1-4aec-baa4-12319eb5ce03 None None] MFA Rules not processed for user `d619ccc0ae2345879a5a6ae84732d20a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:47.741899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f4dde880-e4e1-4aec-baa4-12319eb5ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:47.824606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a7fc5-a689-4da9-8da7-4ef752c2eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.825152 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a7fc5-a689-4da9-8da7-4ef752c2eab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.825593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a7fc5-a689-4da9-8da7-4ef752c2eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.825869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a7fc5-a689-4da9-8da7-4ef752c2eab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.826509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a7fc5-a689-4da9-8da7-4ef752c2eab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.828942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a7fc5-a689-4da9-8da7-4ef752c2eab6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.881658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 652/1308] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:47 2022] POST /identity/v3/users => generated 309 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:47.882998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03debc3-981f-4d03-8896-433e3d5a2fef None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.883289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03debc3-981f-4d03-8896-433e3d5a2fef None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.883564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03debc3-981f-4d03-8896-433e3d5a2fef None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.887776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 653/1309] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 12 12:28:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:28:47.888603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03debc3-981f-4d03-8896-433e3d5a2fef None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.889035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 657/1310] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:47.890138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dde880-e4e1-4aec-baa4-12319eb5ce03 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.920068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dde880-e4e1-4aec-baa4-12319eb5ce03 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.926975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97dc14-339b-4775-847a-ef8199b3232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.927556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03debc3-981f-4d03-8896-433e3d5a2fef None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:47.928247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97dc14-339b-4775-847a-ef8199b3232b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.929201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97dc14-339b-4775-847a-ef8199b3232b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.929973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97dc14-339b-4775-847a-ef8199b3232b admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.930828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97dc14-339b-4775-847a-ef8199b3232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.932455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:47.933060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.933338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.933614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.934212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97dc14-339b-4775-847a-ef8199b3232b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.934323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:47.935838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:47.960998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 654/1311] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:47.961962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:47.972768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 658/1312] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:47.974665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b633-ee25-4fb5-89af-d76228d6b4c5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:47.975424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b633-ee25-4fb5-89af-d76228d6b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:47.975670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b633-ee25-4fb5-89af-d76228d6b4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:47.982072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664646f6-3d56-4c9d-bae3-6875dddf7be4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.003985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.004820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.004961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.005151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.005766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.007873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.023144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9562b633-ee25-4fb5-89af-d76228d6b4c5 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:48.024446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9562b633-ee25-4fb5-89af-d76228d6b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:48.028203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 655/1313] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:48.028203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.123754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:48.126695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423f4b-d3e2-4db4-a889-35604816d46c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.132750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.133745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.134152 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.134432 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.143619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:48.150215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.152644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.175385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 659/1314] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:28:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:48.180015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b633-ee25-4fb5-89af-d76228d6b4c5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.185014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 656/1315] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:48.186692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.208694 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b633-ee25-4fb5-89af-d76228d6b4c5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.215576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831613d-30ab-474a-b785-0287ea9c4d79 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.220030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.220724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.221073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.221349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] PATH_INFO: `/v3/projects/901c14c22d9b4846bfcd1335c4e612b9/users/5191f0104dd54cd29d521884bd128ce2/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.229441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.234232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.234529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.234946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] PATH_INFO: `/v3/projects/4d0ac65dd68e4b3ca92a0c81e486dc1e/users/08fd2e8dd3b0423ab11bf203e9ebf5d8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.238161 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0ac65dd68e4b3ca92a0c81e486dc1e, user_id=08fd2e8dd3b0423ab11bf203e9ebf5d8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.241119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.254596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901c14c22d9b4846bfcd1335c4e612b9, user_id=5191f0104dd54cd29d521884bd128ce2, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.256655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 657/1316] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:48 2022] PUT /identity/v3/projects/4d0ac65dd68e4b3ca92a0c81e486dc1e/users/08fd2e8dd3b0423ab11bf203e9ebf5d8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:48.263949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.268606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.291689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 660/1317] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:48 2022] PUT /identity/v3/projects/901c14c22d9b4846bfcd1335c4e612b9/users/5191f0104dd54cd29d521884bd128ce2/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:48.291689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.372283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8aeb2-b809-4dd2-a3d4-755524157fa8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.378080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534b17-5eae-4f15-a035-4b83c5e2c52c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.378989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534b17-5eae-4f15-a035-4b83c5e2c52c service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.379438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534b17-5eae-4f15-a035-4b83c5e2c52c service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.379677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534b17-5eae-4f15-a035-4b83c5e2c52c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.385339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e762cd-1683-454f-98ba-efcbb19db2db admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.496749 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534b17-5eae-4f15-a035-4b83c5e2c52c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.507144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534b17-5eae-4f15-a035-4b83c5e2c52c service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.518037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.518729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.519012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.519641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] PATH_INFO: `/v3/projects/882e37ae6a3242248bbb95b93a2789b7/users/3306c632df8242cf9626cac3a4ec968f/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.529178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 661/1318] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:48.531422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac542b-7f8f-4875-b6d2-dd71660739c3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.531944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac542b-7f8f-4875-b6d2-dd71660739c3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.532364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac542b-7f8f-4875-b6d2-dd71660739c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.572055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=882e37ae6a3242248bbb95b93a2789b7, user_id=3306c632df8242cf9626cac3a4ec968f, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.574709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.584167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d5ac542b-7f8f-4875-b6d2-dd71660739c3 None None] MFA Rules not processed for user `08fd2e8dd3b0423ab11bf203e9ebf5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:48.586107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d5ac542b-7f8f-4875-b6d2-dd71660739c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:48.604847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 658/1319] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:48 2022] PUT /identity/v3/projects/882e37ae6a3242248bbb95b93a2789b7/users/3306c632df8242cf9626cac3a4ec968f/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:48.607848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.692349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:48.743149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a42c6b-2339-4652-a39f-0a95d16777aa admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.746936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 662/1320] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:48.747958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac542b-7f8f-4875-b6d2-dd71660739c3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.760453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.763349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.764468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.764758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.767541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.780728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.830605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 659/1321] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:48.832199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.864014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0806-fe86-4d68-9d6a-54da90f35e0d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.885429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.887043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.887337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.887610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.890622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.895423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:48.898517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:48.904381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac542b-7f8f-4875-b6d2-dd71660739c3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.925778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 660/1322] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:48.927471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:48.928556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd0960-f001-4057-a79c-ac7c4874d30c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.932433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0960-f001-4057-a79c-ac7c4874d30c service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.932787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0960-f001-4057-a79c-ac7c4874d30c service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.933067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd0960-f001-4057-a79c-ac7c4874d30c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.946224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69375-1347-4cce-953b-0cdb2efdb048 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:48.959748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:48.960867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:48.960867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:48.961112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] PATH_INFO: `/v3/projects/901c14c22d9b4846bfcd1335c4e612b9/users/5191f0104dd54cd29d521884bd128ce2/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:48.964907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=901c14c22d9b4846bfcd1335c4e612b9, user_id=5191f0104dd54cd29d521884bd128ce2, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:48.975036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:49.038880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 661/1323] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:48 2022] PUT /identity/v3/projects/901c14c22d9b4846bfcd1335c4e612b9/users/5191f0104dd54cd29d521884bd128ce2/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:49.038880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:49.169435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd0960-f001-4057-a79c-ac7c4874d30c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:49.180974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd0960-f001-4057-a79c-ac7c4874d30c service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:49.218152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 663/1324] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:49.220893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3adc-eb85-4f91-b6c6-153120341dc8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:49.221180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3adc-eb85-4f91-b6c6-153120341dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:49.221455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3adc-eb85-4f91-b6c6-153120341dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:49.235019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd951f76-7d60-433a-aa8e-b13b04bcd24f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:49.245105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dfc92-56f5-4c6a-baeb-d8f9799ec097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:49.245800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dfc92-56f5-4c6a-baeb-d8f9799ec097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:49.246080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dfc92-56f5-4c6a-baeb-d8f9799ec097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:49.246356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dfc92-56f5-4c6a-baeb-d8f9799ec097 admin admin] PATH_INFO: `/v3/projects/882e37ae6a3242248bbb95b93a2789b7/users/3306c632df8242cf9626cac3a4ec968f/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:49.248778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dfc92-56f5-4c6a-baeb-d8f9799ec097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882e37ae6a3242248bbb95b93a2789b7, user_id=3306c632df8242cf9626cac3a4ec968f, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:49.252562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dfc92-56f5-4c6a-baeb-d8f9799ec097 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:49.290289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 662/1325] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:49 2022] PUT /identity/v3/projects/882e37ae6a3242248bbb95b93a2789b7/users/3306c632df8242cf9626cac3a4ec968f/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:49.300919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38398-c47d-42e0-95d8-713498eca9f4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:49.301283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38398-c47d-42e0-95d8-713498eca9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:49.301662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38398-c47d-42e0-95d8-713498eca9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:49.335233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b94e3adc-eb85-4f91-b6c6-153120341dc8 None None] MFA Rules not processed for user `5191f0104dd54cd29d521884bd128ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:49.338419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b94e3adc-eb85-4f91-b6c6-153120341dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:49.378226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3fb38398-c47d-42e0-95d8-713498eca9f4 None None] MFA Rules not processed for user `3306c632df8242cf9626cac3a4ec968f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:49.379571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3fb38398-c47d-42e0-95d8-713498eca9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:49.561535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 664/1326] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:49.562475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 663/1327] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:49.564247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3adc-eb85-4f91-b6c6-153120341dc8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:49.648738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:49.705376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3adc-eb85-4f91-b6c6-153120341dc8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:49.715065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:49.715707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:49.716014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:49.716290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:49.882434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:49.884572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:49.914372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 665/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:50.161123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38398-c47d-42e0-95d8-713498eca9f4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:50.174944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38398-c47d-42e0-95d8-713498eca9f4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:50.179175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:50.179840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:50.180276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:50.180406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:50.191757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:50.193419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:50.227083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 664/1329] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:50.255604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:50.267365 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dcd9b-c8fb-460d-b47a-b5575f7df94c service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:50.273172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:50.274020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:50.275081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:50.275534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:50.288063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:50.289779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:50.320093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 666/1330] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:50.520882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:50.707468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:50.710568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:50.726660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b3c0-d00a-4d31-ba06-30d66593af32 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:50.736424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e93834-0db9-4e75-88f2-a33b6f78ee3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:50.738663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93834-0db9-4e75-88f2-a33b6f78ee3e service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:50.739049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93834-0db9-4e75-88f2-a33b6f78ee3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:50.741276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93834-0db9-4e75-88f2-a33b6f78ee3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:50.753778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b663-5e54-4610-940a-12d19cabd020 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:50.780498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:50.783429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:50.783919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:50.784296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] PATH_INFO: `/v3/users/c5573444a7e74d738675c5f4d94a84be` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:50.803945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5573444a7e74d738675c5f4d94a84be)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:50.808534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:50.883234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e93834-0db9-4e75-88f2-a33b6f78ee3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:50.885824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e93834-0db9-4e75-88f2-a33b6f78ee3e service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:50.898148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 667/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:50.899995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f82d4-daf5-4cf1-9dea-ea5022861c0f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:50.900424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f82d4-daf5-4cf1-9dea-ea5022861c0f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:50.900840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f82d4-daf5-4cf1-9dea-ea5022861c0f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:50.902427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 668/1332] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 12 12:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:28:50.903238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f82d4-daf5-4cf1-9dea-ea5022861c0f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:50.921286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f82d4-daf5-4cf1-9dea-ea5022861c0f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:50.932387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:50.933295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:50.933791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:50.934240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] PATH_INFO: `/v3/users/4df16c231a164d75a9ad8dbbe09d9380` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:50.935956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df16c231a164d75a9ad8dbbe09d9380)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:50.937105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: WARNING py.warnings [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:28:50.937105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: warnings.warn(msg) Oct 12 12:28:50.937105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: Oct 12 12:28:50.938518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:50.986715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5573444a7e74d738675c5f4d94a84be'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:50.988561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5573444a7e74d738675c5f4d94a84be'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.009829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5573444a7e74d738675c5f4d94a84be'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.012783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5573444a7e74d738675c5f4d94a84be'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.049566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5b541f37-0451-4271-a5ad-7772639628cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5573444a7e74d738675c5f4d94a84be'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.092249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 665/1333] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:28:50 2022] DELETE /identity/v3/users/c5573444a7e74d738675c5f4d94a84be => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:28:51.094238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831920-29f4-4b7c-9162-19911973c200 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:51.096236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831920-29f4-4b7c-9162-19911973c200 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:51.098469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831920-29f4-4b7c-9162-19911973c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:51.107337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df16c231a164d75a9ad8dbbe09d9380'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.108599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df16c231a164d75a9ad8dbbe09d9380'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.170722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7c831920-29f4-4b7c-9162-19911973c200 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:51.172000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7c831920-29f4-4b7c-9162-19911973c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:51.173745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:51.185804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df16c231a164d75a9ad8dbbe09d9380'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.190122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df16c231a164d75a9ad8dbbe09d9380'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.221624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cf60aa88-b489-4a9a-a9ef-a5bb9d8a13a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df16c231a164d75a9ad8dbbe09d9380'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:51.292028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 669/1334] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:28:50 2022] DELETE /identity/v3/users/4df16c231a164d75a9ad8dbbe09d9380 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:51.293459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235328-1998-486a-bee7-f887b7ffd4a2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:51.293787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235328-1998-486a-bee7-f887b7ffd4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:51.294127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235328-1998-486a-bee7-f887b7ffd4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:51.322180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0b235328-1998-486a-bee7-f887b7ffd4a2 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:51.324096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0b235328-1998-486a-bee7-f887b7ffd4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:51.398716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 666/1335] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 12 12:28:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:51.406419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:51.406698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:51.407219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:51.443382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 670/1336] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:51.443382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ba1a-6098-450a-894a-06ce02cfaf31 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:51.443382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ba1a-6098-450a-894a-06ce02cfaf31 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:51.443382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730ba1a-6098-450a-894a-06ce02cfaf31 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:51.445644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:51.446226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 671/1337] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 12 12:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:28:51.447365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:51.454628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:51.454921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:51.455205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:51.463729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 667/1338] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:51.480159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:51.493226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:51.529928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:51.533976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:51.645088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb934d-76a8-4348-b190-8db21b9eb521 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:51.657630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:51.658703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:51.659068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:51.659330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:51.685037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:51.685037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:51.685037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:51.714816 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 668/1339] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:28:51.715787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:51.745790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d617b-c7cb-4cf2-a269-bbb2faeccfa5 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:51.759779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:51.760432 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:51.760718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:51.760989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:51.780713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:51.782815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:51.812591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 669/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:51.949950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 672/1341] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:28:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:51.965755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:51.967311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:52.078428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b14e37-7ea0-481d-b753-2f63100ffaba service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:52.084152 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:52.084846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:52.085230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:52.085531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:52.119030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:52.122525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:52.154754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 670/1342] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:54.451736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:54.453377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:54.476668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206893e9-84c3-4df4-a1a7-b24c3172dc6c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:54.519759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:54.520931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:54.521216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:54.521498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] PATH_INFO: `/v3/projects/0063985e4e814f4389d1fb2cc02fd303` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:54.523100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0063985e4e814f4389d1fb2cc02fd303)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:54.526223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:54.620875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0063985e4e814f4389d1fb2cc02fd303', 'request_id': 'req-54f17795-86bc-48a0-9f91-7229b71e1cfc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:54.630187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0063985e4e814f4389d1fb2cc02fd303', 'request_id': 'req-54f17795-86bc-48a0-9f91-7229b71e1cfc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:54.649788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:54.654244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:54.683335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0063985e4e814f4389d1fb2cc02fd303', 'request_id': 'req-54f17795-86bc-48a0-9f91-7229b71e1cfc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:54.695846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:54.714299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] The token cache is being invalidate because project 0063985e4e814f4389d1fb2cc02fd303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:28:54.715967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:54.717064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:54.723431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 673/1343] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:28:54 2022] DELETE /identity/v3/projects/0063985e4e814f4389d1fb2cc02fd303 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:54.727074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:54.731143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad413c44-345c-4594-b284-717ae3dfee29 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:54.731645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:54.929720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:54.930475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:54.930819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:54.931159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] PATH_INFO: `/v3/projects/f150add4b1944461bac19c65b151d8c9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:54.932696 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f150add4b1944461bac19c65b151d8c9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:54.935022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:28:54.935022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: warnings.warn(msg) Oct 12 12:28:54.935022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: Oct 12 12:28:54.936916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:55.007631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f17795-86bc-48a0-9f91-7229b71e1cfc admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:55.037172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:55.037836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:55.038123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:55.038471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] PATH_INFO: `/v3/users/3306c632df8242cf9626cac3a4ec968f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:55.041419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3306c632df8242cf9626cac3a4ec968f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:55.043247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:55.125388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f150add4b1944461bac19c65b151d8c9', 'request_id': 'req-8a192df5-6e5b-47d1-83f3-252dff678307'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.149874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f150add4b1944461bac19c65b151d8c9', 'request_id': 'req-8a192df5-6e5b-47d1-83f3-252dff678307'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.179088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f150add4b1944461bac19c65b151d8c9', 'request_id': 'req-8a192df5-6e5b-47d1-83f3-252dff678307'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.212954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3306c632df8242cf9626cac3a4ec968f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.214083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3306c632df8242cf9626cac3a4ec968f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.280729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] The token cache is being invalidate because project f150add4b1944461bac19c65b151d8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:28:55.281581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3306c632df8242cf9626cac3a4ec968f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.286421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3306c632df8242cf9626cac3a4ec968f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.289090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.290117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.293642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 671/1344] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:28:54 2022] DELETE /identity/v3/projects/f150add4b1944461bac19c65b151d8c9 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:55.300336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:55.311131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:55.317423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3306c632df8242cf9626cac3a4ec968f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.374226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 674/1345] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:28:54 2022] DELETE /identity/v3/users/3306c632df8242cf9626cac3a4ec968f => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:55.401105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:55.536795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a192df5-6e5b-47d1-83f3-252dff678307 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:55.665669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:55.668130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:55.668667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:55.669305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] PATH_INFO: `/v3/users/08fd2e8dd3b0423ab11bf203e9ebf5d8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:55.671149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fd2e8dd3b0423ab11bf203e9ebf5d8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:55.676695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:55.792877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:55.795648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:55.823524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2b6ac-f9b0-469f-8507-a885747dc744 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:55.828299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fd2e8dd3b0423ab11bf203e9ebf5d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.829894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fd2e8dd3b0423ab11bf203e9ebf5d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.836715 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:55.837798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:55.838098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:55.838563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] PATH_INFO: `/v3/users/5cccd636e68947338c11c9e29292289c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:55.841483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cccd636e68947338c11c9e29292289c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:55.842082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fd2e8dd3b0423ab11bf203e9ebf5d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.843778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fd2e8dd3b0423ab11bf203e9ebf5d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.846920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:55.875716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b52c9c4e-3e23-4861-a2d2-540d620f160b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fd2e8dd3b0423ab11bf203e9ebf5d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.912211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 672/1346] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:28:55 2022] DELETE /identity/v3/users/08fd2e8dd3b0423ab11bf203e9ebf5d8 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:55.919558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cccd636e68947338c11c9e29292289c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.920278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cccd636e68947338c11c9e29292289c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.936262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:55.937015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:55.938344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:55.939358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cccd636e68947338c11c9e29292289c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.940163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cccd636e68947338c11c9e29292289c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.943070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=79,keystone:DELETE=20,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:55.959544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5b2334a6-c3d5-4a03-84c1-825f46dde5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cccd636e68947338c11c9e29292289c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:55.987410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 675/1347] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:28:55 2022] DELETE /identity/v3/users/5cccd636e68947338c11c9e29292289c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:55.988853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:55.989194 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:55.989548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:56.030030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] MFA Rules not processed for user `25492b6965e3422da9e28309b1b8347f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:56.033224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:56.039502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:56.043362 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:56.126684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:56.268145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 676/1348] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:56.283154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 673/1349] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:56.303706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:56.306333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:56.369993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:56.371861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:56.493158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835e1ce-63e8-4a70-b0fc-db7e48d2777c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:56.514499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:56.515198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:56.515324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:56.515555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:56.545726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:56.547435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:56.549317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2727d5-11e2-4e78-ba45-bd265187c8b7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:56.557106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c16c-2e9b-4db5-b938-512e0ebe4ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:56.559890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c16c-2e9b-4db5-b938-512e0ebe4ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:56.569528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 677/1350] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:56.583554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c16c-2e9b-4db5-b938-512e0ebe4ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:56.585564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c16c-2e9b-4db5-b938-512e0ebe4ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:56.620294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80c16c-2e9b-4db5-b938-512e0ebe4ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:56.622027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80c16c-2e9b-4db5-b938-512e0ebe4ab3 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:56.654114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 674/1351] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:56.990198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:56.992643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:57.012906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046dbd3-3643-4f19-9b82-77f1f4d01783 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:57.035768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:57.036037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:57.036814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:57.037094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] PATH_INFO: `/v3/projects/4d0ac65dd68e4b3ca92a0c81e486dc1e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:57.043655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0ac65dd68e4b3ca92a0c81e486dc1e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:57.045820 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:57.159333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0ac65dd68e4b3ca92a0c81e486dc1e', 'request_id': 'req-bedbc4af-eeea-4ade-bb08-c80f60d883ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:57.174245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0ac65dd68e4b3ca92a0c81e486dc1e', 'request_id': 'req-bedbc4af-eeea-4ade-bb08-c80f60d883ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:57.194620 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0ac65dd68e4b3ca92a0c81e486dc1e', 'request_id': 'req-bedbc4af-eeea-4ade-bb08-c80f60d883ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:57.197373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=2,keystone:DELETE=7,keystone:SELECT=91 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:57.215455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] The token cache is being invalidate because project 4d0ac65dd68e4b3ca92a0c81e486dc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:28:57.215869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:57.216748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bedbc4af-eeea-4ade-bb08-c80f60d883ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:57.218808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 678/1352] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:28:56 2022] DELETE /identity/v3/projects/4d0ac65dd68e4b3ca92a0c81e486dc1e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:57.224382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16265-a47f-4a5e-9b15-d6a0c6669563 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:57.224811 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16265-a47f-4a5e-9b15-d6a0c6669563 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:57.224909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16265-a47f-4a5e-9b15-d6a0c6669563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:57.248320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-77c16265-a47f-4a5e-9b15-d6a0c6669563 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:57.249605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-77c16265-a47f-4a5e-9b15-d6a0c6669563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:57.367136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 675/1353] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:57.376589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973269d-b30b-48e3-9485-723fb33b4931 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:57.376904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973269d-b30b-48e3-9485-723fb33b4931 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:57.377149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973269d-b30b-48e3-9485-723fb33b4931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:57.407189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e973269d-b30b-48e3-9485-723fb33b4931 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:57.410178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e973269d-b30b-48e3-9485-723fb33b4931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:57.420971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 679/1354] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:57.426129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16265-a47f-4a5e-9b15-d6a0c6669563 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:57.445365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16265-a47f-4a5e-9b15-d6a0c6669563 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:57.460668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:57.461486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:57.462356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:57.462783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:57.463677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:28:57.467064 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:57.477398 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:57.508700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 676/1355] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:28:57.511678 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973269d-b30b-48e3-9485-723fb33b4931 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:57.524808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973269d-b30b-48e3-9485-723fb33b4931 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:57.545539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:57.546270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:57.546651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:57.547168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:57.548002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:57.553576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:57.675731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 680/1356] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:57 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:57.682531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:57.701992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18069595-d9a4-4e41-961d-79b773a09b5f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:57.765288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:57.766340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:57.955366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:57.957323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:57.957865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:57.959562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:57.961952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:57.969221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:58.003055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:58.013652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4830e-7f84-45a0-a01c-4b9dbdf27d02 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:58.031449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:58.032752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:58.033403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:58.033532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] PATH_INFO: `/v3/users/e4c4803ca1e0401f92dde6cc91153c5a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:58.035468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 677/1357] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:57 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:28:58.036496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c4803ca1e0401f92dde6cc91153c5a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:58.038448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:58.039324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:58.063103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7855ca-8aeb-4e9f-b903-1669ba103c65 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:58.073600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:58.074230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:58.074508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:58.074777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:58.075431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:58.077058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:58.125198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 678/1358] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:58.127674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:58.160332 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b86612-5924-4040-9776-c085a8f59bae admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:58.172703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c4803ca1e0401f92dde6cc91153c5a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.172941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:58.173825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c4803ca1e0401f92dde6cc91153c5a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.175224 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:58.175514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:58.177063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:58.182519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:58.193697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:58.220753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c4803ca1e0401f92dde6cc91153c5a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.222307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c4803ca1e0401f92dde6cc91153c5a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.230207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 679/1359] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:28:58.230207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:58.237820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:58.248763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c4803ca1e0401f92dde6cc91153c5a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.265793 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687066f-d8b5-4ca1-b9d4-689422d9b723 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:58.270918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 681/1360] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:28:57 2022] DELETE /identity/v3/users/e4c4803ca1e0401f92dde6cc91153c5a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:58.272173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:58.273939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:58.282343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:58.283556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:58.283880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:58.284159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] PATH_INFO: `/v3/projects/1e85d8f1243d4e2db89b8e812435dadf` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:58.288820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e85d8f1243d4e2db89b8e812435dadf)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:58.292172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:58.379598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:58.425971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e85d8f1243d4e2db89b8e812435dadf', 'request_id': 'req-94ca5e71-2d9a-4674-9757-eb4d5407adfb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.430540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a87f-7ae5-4c93-a264-b363767e1b5a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:58.443181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e85d8f1243d4e2db89b8e812435dadf', 'request_id': 'req-94ca5e71-2d9a-4674-9757-eb4d5407adfb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.461918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e85d8f1243d4e2db89b8e812435dadf', 'request_id': 'req-94ca5e71-2d9a-4674-9757-eb4d5407adfb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.488771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] The token cache is being invalidate because project 1e85d8f1243d4e2db89b8e812435dadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:28:58.489361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.490481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.494782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 680/1361] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:28:58 2022] DELETE /identity/v3/projects/1e85d8f1243d4e2db89b8e812435dadf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:58.494782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:58.495925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:58.565229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:58.567725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:58.568080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:58.568361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] PATH_INFO: `/v3/projects/882e37ae6a3242248bbb95b93a2789b7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:58.572131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=882e37ae6a3242248bbb95b93a2789b7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:58.574607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:58.665876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5e71-2d9a-4674-9757-eb4d5407adfb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:58.685991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334e75-393e-450f-add5-113603a0fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:58.690381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334e75-393e-450f-add5-113603a0fa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:58.690381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334e75-393e-450f-add5-113603a0fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:58.690381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334e75-393e-450f-add5-113603a0fa69 admin admin] PATH_INFO: `/v3/projects/a8544a449033468a9a242410e3211863/users/b30fe32459244d74a066efcd9160f630/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:58.736302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334e75-393e-450f-add5-113603a0fa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8544a449033468a9a242410e3211863, user_id=b30fe32459244d74a066efcd9160f630, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:58.739574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334e75-393e-450f-add5-113603a0fa69 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:58.763416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882e37ae6a3242248bbb95b93a2789b7', 'request_id': 'req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.778762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 681/1362] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:28:58 2022] PUT /identity/v3/projects/a8544a449033468a9a242410e3211863/users/b30fe32459244d74a066efcd9160f630/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:58.780577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f407d-91c5-4aab-9ded-97dd8f22522d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:58.780577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f407d-91c5-4aab-9ded-97dd8f22522d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:58.780901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f407d-91c5-4aab-9ded-97dd8f22522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:58.788476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882e37ae6a3242248bbb95b93a2789b7', 'request_id': 'req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.808432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882e37ae6a3242248bbb95b93a2789b7', 'request_id': 'req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.828956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-652f407d-91c5-4aab-9ded-97dd8f22522d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:58.831623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] The token cache is being invalidate because project 882e37ae6a3242248bbb95b93a2789b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:28:58.832128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.833360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:58.835405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-652f407d-91c5-4aab-9ded-97dd8f22522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:58.835573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 682/1363] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:28:58 2022] DELETE /identity/v3/projects/882e37ae6a3242248bbb95b93a2789b7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:58.836838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:58.838679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:58.914058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:58.980763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e3bc-9610-49f3-b4a8-0c1b8a4bca3b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:59.013305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 682/1364] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:59.013998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62078032-bb23-423a-b136-861f786838c5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.014291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62078032-bb23-423a-b136-861f786838c5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.015774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62078032-bb23-423a-b136-861f786838c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.044806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:59.099769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-62078032-bb23-423a-b136-861f786838c5 None None] MFA Rules not processed for user `b30fe32459244d74a066efcd9160f630`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:59.101513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-62078032-bb23-423a-b136-861f786838c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:59.159351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:59.164019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.164307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.164589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] PATH_INFO: `/v3/users/d619ccc0ae2345879a5a6ae84732d20a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.169191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d619ccc0ae2345879a5a6ae84732d20a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:59.177161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:59.300319 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 683/1365] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:59.303094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.303423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.303702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.320721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd619ccc0ae2345879a5a6ae84732d20a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:59.321731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd619ccc0ae2345879a5a6ae84732d20a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:59.359256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd619ccc0ae2345879a5a6ae84732d20a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:59.359786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:59.360206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd619ccc0ae2345879a5a6ae84732d20a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:59.365192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:59.378396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd619ccc0ae2345879a5a6ae84732d20a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:28:59.388003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 684/1366] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:59.390214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:59.394533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:59.409448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 683/1367] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:28:58 2022] DELETE /identity/v3/users/d619ccc0ae2345879a5a6ae84732d20a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:28:59.409448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:28:59.413451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:59.503966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867ed92-fa40-4caa-9223-2875cdb0c4e4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:59.598328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3825de-3050-4e2b-8a16-41cd58d785ec admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:28:59.618134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ec880-f69b-4599-b7a3-65c070983d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:59.620134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ec880-f69b-4599-b7a3-65c070983d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.620427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ec880-f69b-4599-b7a3-65c070983d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.621481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ec880-f69b-4599-b7a3-65c070983d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.623893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ec880-f69b-4599-b7a3-65c070983d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:59.625910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ec880-f69b-4599-b7a3-65c070983d93 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:59.629124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c37956-38cd-42aa-9275-dee1c3f5b803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:28:59.629887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c37956-38cd-42aa-9275-dee1c3f5b803 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.630233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c37956-38cd-42aa-9275-dee1c3f5b803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.630676 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c37956-38cd-42aa-9275-dee1c3f5b803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.635103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-92c37956-38cd-42aa-9275-dee1c3f5b803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:59.678405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c37956-38cd-42aa-9275-dee1c3f5b803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:28:59.681209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c37956-38cd-42aa-9275-dee1c3f5b803 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:28:59.705720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 684/1368] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:28:59 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:28:59.707349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4122-42a8-4878-ba6c-426b0cd53a4d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.709093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 685/1369] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:28:59.709638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4122-42a8-4878-ba6c-426b0cd53a4d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.710581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16430ade-0177-40c4-9068-0245bf66dd09 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.710874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16430ade-0177-40c4-9068-0245bf66dd09 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.711151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16430ade-0177-40c4-9068-0245bf66dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.718330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4122-42a8-4878-ba6c-426b0cd53a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.762845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-16430ade-0177-40c4-9068-0245bf66dd09 None None] MFA Rules not processed for user `25492b6965e3422da9e28309b1b8347f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:59.768138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-16430ade-0177-40c4-9068-0245bf66dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:59.770220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cfec4122-42a8-4878-ba6c-426b0cd53a4d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:28:59.777108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cfec4122-42a8-4878-ba6c-426b0cd53a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:28:59.801073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:59.849304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:28:59.939890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 685/1370] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:59.941929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093f9a-f062-4286-8253-397bc5d53532 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:28:59.944348 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093f9a-f062-4286-8253-397bc5d53532 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:28:59.946804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093f9a-f062-4286-8253-397bc5d53532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:28:59.957897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 686/1371] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:28:59.962188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16430ade-0177-40c4-9068-0245bf66dd09 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.004657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16430ade-0177-40c4-9068-0245bf66dd09 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.037651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.038473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.038762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.039039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.039693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.041740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.074537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5b093f9a-f062-4286-8253-397bc5d53532 None None] MFA Rules not processed for user `f83067d716e74d69bdffadb7e6c2ff6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:00.078455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5b093f9a-f062-4286-8253-397bc5d53532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:00.090561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 687/1372] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:28:59 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:00.091500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.121240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01e5ac-670c-4702-b6ec-28916c50ae60 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.142221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.142857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.143140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.143412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.144115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:00.144420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.146030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.174151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 688/1373] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:00.175054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.237448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad157-259b-4190-bd07-7326046858d2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.275530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.276625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.276928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.277216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.278080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.283284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.302282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 686/1374] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:00.303823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b093f9a-f062-4286-8253-397bc5d53532 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.306505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 689/1375] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:00.310380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.317357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b093f9a-f062-4286-8253-397bc5d53532 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.322925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.323995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.324893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.324893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.325831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.327998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.335297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54270be5-d49f-4307-bb82-0b06205a645b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.347863 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.348541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.348825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.349099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] PATH_INFO: `/v3/projects/bb099b44865d458f990613efd03d1132/users/fa67d10d92d040e0b64b41441cf7e9bb/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.376049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 687/1376] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:00 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:00.378117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.384168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:00.386838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb099b44865d458f990613efd03d1132, user_id=fa67d10d92d040e0b64b41441cf7e9bb, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.395171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.422236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 690/1377] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:00 2022] PUT /identity/v3/projects/bb099b44865d458f990613efd03d1132/users/fa67d10d92d040e0b64b41441cf7e9bb/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:00.423089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.615291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83757-3499-46e9-9658-ae5ab909f0a3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.645999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.646647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.646935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.647208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.647889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.650275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.653423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426014be-6b0c-43ac-87cb-fca66723c411 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.713884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 691/1378] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:00 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:00.714749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.744570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:00.750703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1a42-1cf2-40a7-b0f1-6ee9846addae admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.759248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.762313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.762519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.762806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.763509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.765234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.795923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 692/1379] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:00.796957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.815330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7dbed-a39a-4c02-bff1-5257cf99f53d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.816226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7dbed-a39a-4c02-bff1-5257cf99f53d service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.816607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7dbed-a39a-4c02-bff1-5257cf99f53d service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.817209 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7dbed-a39a-4c02-bff1-5257cf99f53d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.832341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804585cb-e6cd-4211-bf9d-8e537da28b5d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.838885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.839519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.839877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.840697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.841804 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.843432 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.888668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 693/1380] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:00.891779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.913180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56772c-1817-4e26-823a-95245d312dc6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:00.929194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:00.930028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:00.930399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:00.930774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] PATH_INFO: `/v3/projects/bb099b44865d458f990613efd03d1132/users/fa67d10d92d040e0b64b41441cf7e9bb/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:00.933232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb099b44865d458f990613efd03d1132, user_id=fa67d10d92d040e0b64b41441cf7e9bb, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.935907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.953099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7dbed-a39a-4c02-bff1-5257cf99f53d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:00.956090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7dbed-a39a-4c02-bff1-5257cf99f53d service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:00.967683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 694/1381] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:00 2022] PUT /identity/v3/projects/bb099b44865d458f990613efd03d1132/users/fa67d10d92d040e0b64b41441cf7e9bb/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:00.969038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:00.990413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 688/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:01.006990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913735-c7aa-4cba-927f-083a3de05e20 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.019538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913735-c7aa-4cba-927f-083a3de05e20 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.019538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913735-c7aa-4cba-927f-083a3de05e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.024714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:01.097922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4e913735-c7aa-4cba-927f-083a3de05e20 None None] MFA Rules not processed for user `fa67d10d92d040e0b64b41441cf7e9bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:01.100714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4e913735-c7aa-4cba-927f-083a3de05e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:01.162614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058ee8b-3b2c-4788-9e17-6af1f0f6ac04 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:01.184009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:01.184940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.185783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.186383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.195038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:01.198299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:01.232800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 695/1383] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:01.235149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:01.240579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:01.270615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35793a1-036d-495c-a2a5-cb81dad9f3a7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:01.274982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 689/1384] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:01.276266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913735-c7aa-4cba-927f-083a3de05e20 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:01.299630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913735-c7aa-4cba-927f-083a3de05e20 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:01.309766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:01.310363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:01.310752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.311268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.311724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.311974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] PATH_INFO: `/v3/projects/a6c5a27a7e4e4f7b83eb192cef4a9602` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.312088 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.312304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] PATH_INFO: `/v3/projects/62ee9d319879462c8248091062f5d1ba/users/99e9ccf99b284f91a5238fb80b68c822/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.318522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c5a27a7e4e4f7b83eb192cef4a9602)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:01.322726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:01.354165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ee9d319879462c8248091062f5d1ba, user_id=99e9ccf99b284f91a5238fb80b68c822, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:01.357351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:01.384257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 690/1385] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:01 2022] PUT /identity/v3/projects/62ee9d319879462c8248091062f5d1ba/users/99e9ccf99b284f91a5238fb80b68c822/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:01.385206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:01.387583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:01.432985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c5a27a7e4e4f7b83eb192cef4a9602', 'request_id': 'req-ce7e9b55-0992-46e0-b444-645064fcb469'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.451061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c5a27a7e4e4f7b83eb192cef4a9602', 'request_id': 'req-ce7e9b55-0992-46e0-b444-645064fcb469'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.461052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c5a27a7e4e4f7b83eb192cef4a9602', 'request_id': 'req-ce7e9b55-0992-46e0-b444-645064fcb469'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.483477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:01.485182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] The token cache is being invalidate because project a6c5a27a7e4e4f7b83eb192cef4a9602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:01.485484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.486627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.491937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 696/1386] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:01 2022] DELETE /identity/v3/projects/a6c5a27a7e4e4f7b83eb192cef4a9602 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:01.492838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:01.495218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:01.533633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d5502-e0f1-445f-a8b9-c57fa5f168da admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:01.619843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e9b55-0992-46e0-b444-645064fcb469 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:01.633932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6bbea-860c-4738-bcf6-a52b8a5159b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:01.636489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bbea-860c-4738-bcf6-a52b8a5159b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.636977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bbea-860c-4738-bcf6-a52b8a5159b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.637407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bbea-860c-4738-bcf6-a52b8a5159b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.642575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-17c6bbea-860c-4738-bcf6-a52b8a5159b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:01.661058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:01.661934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.662602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.663187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] PATH_INFO: `/v3/projects/d1790dd68b4e4f699a2b18d021d23bb5` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.665027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1790dd68b4e4f699a2b18d021d23bb5)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:01.667274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:01.766137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:01.793580 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1790dd68b4e4f699a2b18d021d23bb5', 'request_id': 'req-e8d460a7-db3a-4c6a-9bff-897222cbb86a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.812879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1790dd68b4e4f699a2b18d021d23bb5', 'request_id': 'req-e8d460a7-db3a-4c6a-9bff-897222cbb86a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.823562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6bbea-860c-4738-bcf6-a52b8a5159b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:01.828032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6bbea-860c-4738-bcf6-a52b8a5159b6 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:01.838868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1790dd68b4e4f699a2b18d021d23bb5', 'request_id': 'req-e8d460a7-db3a-4c6a-9bff-897222cbb86a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.858512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 697/1387] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:01.862266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed7f5-5512-4d99-9d96-1985aca17e21 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.863155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] The token cache is being invalidate because project d1790dd68b4e4f699a2b18d021d23bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:01.863562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.863708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed7f5-5512-4d99-9d96-1985aca17e21 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.864151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed7f5-5512-4d99-9d96-1985aca17e21 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.868616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e8d460a7-db3a-4c6a-9bff-897222cbb86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:01.874971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 691/1388] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:01 2022] DELETE /identity/v3/projects/d1790dd68b4e4f699a2b18d021d23bb5 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:01.874971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bf5f-593c-4590-bbd8-ea129579ea89 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.874971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bf5f-593c-4590-bbd8-ea129579ea89 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.874971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bf5f-593c-4590-bbd8-ea129579ea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.879611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 698/1389] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 12 12:29:01 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:29:01.884230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96952-bc30-486f-9ca5-831030e5dd16 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:01.884760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96952-bc30-486f-9ca5-831030e5dd16 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:01.886261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96952-bc30-486f-9ca5-831030e5dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:01.959171 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bbd96952-bc30-486f-9ca5-831030e5dd16 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:01.962965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bbd96952-bc30-486f-9ca5-831030e5dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:01.973028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d898bf5f-593c-4590-bbd8-ea129579ea89 None None] MFA Rules not processed for user `99e9ccf99b284f91a5238fb80b68c822`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:01.976119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d898bf5f-593c-4590-bbd8-ea129579ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:02.146814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 699/1390] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:02.149499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cd670-b7a7-46c6-a851-15636a495c4d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.152035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cd670-b7a7-46c6-a851-15636a495c4d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.152401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cd670-b7a7-46c6-a851-15636a495c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.197611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-927cd670-b7a7-46c6-a851-15636a495c4d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:02.205957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-927cd670-b7a7-46c6-a851-15636a495c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:02.232139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 700/1391] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:02.237994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 692/1392] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:02.239776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.240092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.240370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.240495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db9d0-ac4a-42d7-858c-fcc3e7001b3a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.240698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db9d0-ac4a-42d7-858c-fcc3e7001b3a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.243230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db9d0-ac4a-42d7-858c-fcc3e7001b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.258831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:02.287212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:02.288703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:02.308860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 693/1393] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:02.313059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.315235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:02.348725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb367e6-aaa5-495a-8109-2afa24345a26 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:02.361331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47833ed4-a726-4c6e-a60e-2e0c5822a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:02.362723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833ed4-a726-4c6e-a60e-2e0c5822a02e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.363231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833ed4-a726-4c6e-a60e-2e0c5822a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.363560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833ed4-a726-4c6e-a60e-2e0c5822a02e admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.365148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47833ed4-a726-4c6e-a60e-2e0c5822a02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:02.368490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47833ed4-a726-4c6e-a60e-2e0c5822a02e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:02.398094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-458db9d0-ac4a-42d7-858c-fcc3e7001b3a None None] MFA Rules not processed for user `319b5538054c49d19ecc0b9c9cfc5b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:02.401709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-458db9d0-ac4a-42d7-858c-fcc3e7001b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:02.442587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 694/1394] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:02.445130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391d6c-de2b-4952-9ba6-723d18ffd9a9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.445862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391d6c-de2b-4952-9ba6-723d18ffd9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.446269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391d6c-de2b-4952-9ba6-723d18ffd9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.474139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-24391d6c-de2b-4952-9ba6-723d18ffd9a9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:02.475565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-24391d6c-de2b-4952-9ba6-723d18ffd9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:02.626379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 701/1395] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:02.629273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db9d0-ac4a-42d7-858c-fcc3e7001b3a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.639565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 695/1396] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:02.640656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24391d6c-de2b-4952-9ba6-723d18ffd9a9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.656461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db9d0-ac4a-42d7-858c-fcc3e7001b3a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:02.662433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:02.663061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.663342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.663615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.664305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:02.664685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:02.666700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:02.685065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24391d6c-de2b-4952-9ba6-723d18ffd9a9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:02.686725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 702/1397] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:02.687738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.690228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:02.706866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:02.707420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.707700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.708030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.713060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:02.715387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:02.793386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 696/1398] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:02.794335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.828524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be04e53-7933-484d-a0ff-9f7a4b9413bf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:02.838119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:02.838754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.839083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.839397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.849120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:02.850167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8c3c-f918-4b34-8b3d-81616269b44e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:02.850706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:02.860757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:02.868539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 703/1399] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:02.869403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:02.869644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.870033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.870320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.870593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.871261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:02.871563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:02.873206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:02.900963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329da09-e886-48f0-ae1d-4fd96c6a9106 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:02.909635 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:02.911119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.912512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.913195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.913998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:02.916502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:02.930162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 697/1400] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:02.931047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.953837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb23a-bc5f-408a-ad89-2e82137b0b99 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:02.973425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:02.974053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:02.974372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:02.974596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:02.975004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 704/1401] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:02.975240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:02.976190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:02.976870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:03.003027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 698/1402] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:03.016464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:03.037883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001e29-d54b-4235-bd32-8aa4ea4ea636 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:03.148310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44183-9ab3-4af8-95a2-4c398bbd8347 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:03.162223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:03.162849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:03.163140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:03.163420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:03.164109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:03.166057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:03.208817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:03.209368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:03.209669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:03.209939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:03.244152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:03.244152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:03.248380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 705/1403] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:02 2022] POST /identity/v3/projects => generated 379 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:03.256127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:03.280395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 699/1404] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:03 2022] POST /identity/v3/users => generated 302 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:03.281489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:03.312152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbc36a-7e20-40fb-b5e7-ebadb8eae855 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:03.377039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:03.490506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0b66-6c9b-489a-be1c-746a3280ec9f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:03.506901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:03.508122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:03.508588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:03.509095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] PATH_INFO: `/v3/projects/27603d81181f41da81005a07a9c5da16/users/54bd5e3bfe7243faa7de80315f627289/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:03.512415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:03.513043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:03.513325 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:03.519905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:03.519905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:03.522329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:03.555576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27603d81181f41da81005a07a9c5da16, user_id=54bd5e3bfe7243faa7de80315f627289, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:03.563832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:03.592861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 700/1405] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:03 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:03.595848 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:03.611389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 706/1406] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:03 2022] PUT /identity/v3/projects/27603d81181f41da81005a07a9c5da16/users/54bd5e3bfe7243faa7de80315f627289/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:03.614005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:03.651099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fb23b-6bdb-4754-80e2-3676d5f3483d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:03.835258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:03.883009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcf98d-5b64-49f2-bb3b-3c5e837fdf07 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:03.894412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:03.895713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:03.896034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:03.896313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:03.896978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:03.902297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:03.929159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 707/1407] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:03.929858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:03.949737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:03.950422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:03.950728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:03.951053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:03.965107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481152b-6b94-49d7-8fc9-a0db4ef1825e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:03.966077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:03.967886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:03.984717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:03.984717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:03.984717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:03.985698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:03.997140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.006705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.026919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 701/1408] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:04.036892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:04.044323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.047757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 708/1409] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:04.055727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:04.080199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c8d7-a602-4131-8a9e-c774ca318790 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:04.093700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:04.094181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe676-51f5-4ef1-b694-fa3502125094 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:04.094376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.094717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.095059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.095975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.098047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.120025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:04.120760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.121184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.121471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] PATH_INFO: `/v3/users/b30fe32459244d74a066efcd9160f630` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.124724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 709/1410] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:04.125911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:04.129299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30fe32459244d74a066efcd9160f630)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.130954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.131619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.293675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0cbea-6d24-4423-8b11-701f3a20d918 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:04.309026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30fe32459244d74a066efcd9160f630'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:04.312666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30fe32459244d74a066efcd9160f630'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:04.317044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:04.317792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.319687 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.320133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.322694 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.341604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30fe32459244d74a066efcd9160f630'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:04.342443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30fe32459244d74a066efcd9160f630'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:04.343716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.351068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.354431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30fe32459244d74a066efcd9160f630'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:04.385843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 702/1411] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:04 2022] DELETE /identity/v3/users/b30fe32459244d74a066efcd9160f630 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:04.387360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:04.390421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 710/1412] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:04.390864 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.392662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:04.395491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.431125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4da2b-19ad-4176-9f48-fa01a90babb4 service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:04.461485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:04.555595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ce9e9-9b70-4adc-bac8-1395a0eb46d7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:04.569600 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:04.570565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.571034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.571638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.580729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.583011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.586003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ca8e-3593-4d40-bdfc-e4e932e2a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:04.586703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ca8e-3593-4d40-bdfc-e4e932e2a8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.586988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ca8e-3593-4d40-bdfc-e4e932e2a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.587267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ca8e-3593-4d40-bdfc-e4e932e2a8bc admin admin] PATH_INFO: `/v3/projects/27603d81181f41da81005a07a9c5da16/users/54bd5e3bfe7243faa7de80315f627289/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.591902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ca8e-3593-4d40-bdfc-e4e932e2a8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=27603d81181f41da81005a07a9c5da16, user_id=54bd5e3bfe7243faa7de80315f627289, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.599199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ca8e-3593-4d40-bdfc-e4e932e2a8bc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.604764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 703/1413] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:04.605835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:04.607868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.622636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201ec87-fdb9-44d3-a664-d773726e3996 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:04.633324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:04.634340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.635268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.635727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] PATH_INFO: `/v3/projects/0791965fe60848ff851fd7d99d5d7e9b/users/e3de779b117e45e6ab92f9cd44cf9246/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.646263 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 711/1414] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:04 2022] PUT /identity/v3/projects/27603d81181f41da81005a07a9c5da16/users/54bd5e3bfe7243faa7de80315f627289/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:04.658816 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839586ba-c0b1-49ce-bd92-63aa674f3f74 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.659178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839586ba-c0b1-49ce-bd92-63aa674f3f74 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.659446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839586ba-c0b1-49ce-bd92-63aa674f3f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.674486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0791965fe60848ff851fd7d99d5d7e9b, user_id=e3de779b117e45e6ab92f9cd44cf9246, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.678972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.699707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 704/1415] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:04 2022] PUT /identity/v3/projects/0791965fe60848ff851fd7d99d5d7e9b/users/e3de779b117e45e6ab92f9cd44cf9246/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:04.700777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:04.706621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-839586ba-c0b1-49ce-bd92-63aa674f3f74 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:04.709100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-839586ba-c0b1-49ce-bd92-63aa674f3f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.786549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:04.835967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb273b2-ca5c-415b-ae2d-478f696fd256 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:04.844251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 712/1416] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:04.854394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.854867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.855151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.860761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc00a7-d931-4635-b362-561f3527dfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:04.861986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc00a7-d931-4635-b362-561f3527dfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.862269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc00a7-d931-4635-b362-561f3527dfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.862543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc00a7-d931-4635-b362-561f3527dfb4 admin admin] PATH_INFO: `/v3/projects/41bd09c8c5c74062ba48c7e314f27da1/users/b11bb4a919764cb58b5dc1aba253677f/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:04.925721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc00a7-d931-4635-b362-561f3527dfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bd09c8c5c74062ba48c7e314f27da1, user_id=b11bb4a919764cb58b5dc1aba253677f, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:04.931037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc00a7-d931-4635-b362-561f3527dfb4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:04.959841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] MFA Rules not processed for user `54bd5e3bfe7243faa7de80315f627289`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:04.968160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:04.979823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 705/1417] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:04 2022] PUT /identity/v3/projects/41bd09c8c5c74062ba48c7e314f27da1/users/b11bb4a919764cb58b5dc1aba253677f/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:04.985142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487e7b3-6e14-4db9-8179-cf5240778c4a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:04.985390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487e7b3-6e14-4db9-8179-cf5240778c4a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:04.985672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487e7b3-6e14-4db9-8179-cf5240778c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.055285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9487e7b3-6e14-4db9-8179-cf5240778c4a None None] MFA Rules not processed for user `e3de779b117e45e6ab92f9cd44cf9246`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:05.058778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9487e7b3-6e14-4db9-8179-cf5240778c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.191246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 713/1418] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:05.206882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:05.216425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.245503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 706/1419] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:05.246800 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0ded8-1bca-4944-adfd-9d7daa803d72 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.247090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0ded8-1bca-4944-adfd-9d7daa803d72 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.247365 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0ded8-1bca-4944-adfd-9d7daa803d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.278810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:05.330505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-89e0ded8-1bca-4944-adfd-9d7daa803d72 None None] MFA Rules not processed for user `ca414f641d5946c1ba498ddeaf8cc25d`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:05.331736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-89e0ded8-1bca-4944-adfd-9d7daa803d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.384765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214174ea-0004-4b4d-a631-dd4d06fb349b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:05.394681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:05.395178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.395521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.395757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.464609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 707/1420] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:05.466311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb929-f5a4-4843-839c-12e21c5d8617 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.466609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb929-f5a4-4843-839c-12e21c5d8617 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.467331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eb929-f5a4-4843-839c-12e21c5d8617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.498079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-328eb929-f5a4-4843-839c-12e21c5d8617 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:05.501132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-328eb929-f5a4-4843-839c-12e21c5d8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.550686 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:05.552286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:05.563930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 714/1421] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:05.565029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:05.566575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.596560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:05.630895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 708/1422] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:05.639417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb929-f5a4-4843-839c-12e21c5d8617 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:05.652536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30ad0-260e-4517-aea0-22d988380df3 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:05.654606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eb929-f5a4-4843-839c-12e21c5d8617 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:05.657452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7631e3-a58c-40ee-82d4-100576745458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:05.659128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7631e3-a58c-40ee-82d4-100576745458 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.659724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7631e3-a58c-40ee-82d4-100576745458 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.660259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7631e3-a58c-40ee-82d4-100576745458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.660847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49de3-781c-45d4-9a1f-faeef8051132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:05.662422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49de3-781c-45d4-9a1f-faeef8051132 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.662422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49de3-781c-45d4-9a1f-faeef8051132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.662955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49de3-781c-45d4-9a1f-faeef8051132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.663964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9b7631e3-a58c-40ee-82d4-100576745458 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.664137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49de3-781c-45d4-9a1f-faeef8051132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:05.666457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49de3-781c-45d4-9a1f-faeef8051132 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:05.713383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 709/1423] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:05 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:05.713383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.713383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.713383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.738499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] MFA Rules not processed for user `ca414f641d5946c1ba498ddeaf8cc25d`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:05.740478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.781486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7631e3-a58c-40ee-82d4-100576745458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:05.783257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7631e3-a58c-40ee-82d4-100576745458 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:05.793961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 715/1424] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:05.795513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86d00-c489-4b13-a2c4-20df41f0b8e6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.796048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86d00-c489-4b13-a2c4-20df41f0b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.796435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86d00-c489-4b13-a2c4-20df41f0b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:05.820730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cbf86d00-c489-4b13-a2c4-20df41f0b8e6 None None] MFA Rules not processed for user `f83067d716e74d69bdffadb7e6c2ff6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:05.821960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cbf86d00-c489-4b13-a2c4-20df41f0b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.844734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 710/1425] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:05.846034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:05.848518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:05.875250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:05.908849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 716/1426] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:05.909859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf86d00-c489-4b13-a2c4-20df41f0b8e6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:05.923222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17842803-1ba5-43ca-bfde-da280d715391 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:05.927685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:05.928587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:05.929158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:05.929568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:06.120681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:06.123629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:06.157520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 711/1427] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:06.158649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:06.162759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:06.212246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf86d00-c489-4b13-a2c4-20df41f0b8e6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:06.237885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:06.238528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:06.238806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:06.239076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:06.243669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:06.245734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:06.330277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 717/1428] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:05 2022] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:06.331604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:06.338754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:06.378433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335fb40-bc8d-458e-897b-88fbb8c29866 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:06.389779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:06.393780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:06.394800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:06.394800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] PATH_INFO: `/v3/projects/a8544a449033468a9a242410e3211863` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:06.397397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8544a449033468a9a242410e3211863)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:06.403618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:06.415402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:06.447480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df679f6-4acf-4897-b900-375e08a94b3d service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:06.466025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:06.466787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:06.467170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:06.467582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:06.494064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:06.496285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:06.517513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 712/1429] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:06.519436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:06.553307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ecd9b-9c9d-42b1-b12c-ab1b82c57575 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:06.578958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8544a449033468a9a242410e3211863', 'request_id': 'req-82909996-cd81-4fb6-8394-189facced255'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.607904 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8544a449033468a9a242410e3211863', 'request_id': 'req-82909996-cd81-4fb6-8394-189facced255'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.625372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8544a449033468a9a242410e3211863', 'request_id': 'req-82909996-cd81-4fb6-8394-189facced255'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.640055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] The token cache is being invalidate because project a8544a449033468a9a242410e3211863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:06.640573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.641624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.643870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 718/1430] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:06 2022] DELETE /identity/v3/projects/a8544a449033468a9a242410e3211863 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:06.647700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:06.656741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:06.782210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:06.813392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:06.815557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:06.817562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:06.817935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:06.819746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:06.825134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:06.852875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909996-cd81-4fb6-8394-189facced255 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:06.857642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 713/1431] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:06.860681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:06.865548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:06.875168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:06.875845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:06.876229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:06.876392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] PATH_INFO: `/v3/users/fa67d10d92d040e0b64b41441cf7e9bb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:06.880229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa67d10d92d040e0b64b41441cf7e9bb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:06.882204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:06.902554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ed9c-e7ff-48de-afef-6eab778ad252 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:06.919275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:06.919935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:06.920222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:06.920502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:06.923975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:06.928119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:06.958624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa67d10d92d040e0b64b41441cf7e9bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.959828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa67d10d92d040e0b64b41441cf7e9bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.964413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 714/1432] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:06.966108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:06.968465 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:06.987140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa67d10d92d040e0b64b41441cf7e9bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:06.994292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa67d10d92d040e0b64b41441cf7e9bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:07.012379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf903-92ed-46fd-8e38-b3060efed714 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:07.024052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-188afab6-e44e-41fe-a01c-998cd66414a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa67d10d92d040e0b64b41441cf7e9bb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:07.024372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19f9c-1e1e-437a-829b-8b0486d1bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:07.025154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19f9c-1e1e-437a-829b-8b0486d1bc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.025818 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19f9c-1e1e-437a-829b-8b0486d1bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.027180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19f9c-1e1e-437a-829b-8b0486d1bc16 admin admin] PATH_INFO: `/v3/projects/0f26d520c4984c27966cbc0734378454/users/e085499376ee4a6e977eb8e66373d645/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.064271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 719/1433] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:06 2022] DELETE /identity/v3/users/fa67d10d92d040e0b64b41441cf7e9bb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:07.069863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19f9c-1e1e-437a-829b-8b0486d1bc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f26d520c4984c27966cbc0734378454, user_id=e085499376ee4a6e977eb8e66373d645, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:07.074367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19f9c-1e1e-437a-829b-8b0486d1bc16 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:07.100880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 715/1434] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:06 2022] PUT /identity/v3/projects/0f26d520c4984c27966cbc0734378454/users/e085499376ee4a6e977eb8e66373d645/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:07.113654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d91ffc-1907-4636-96f5-b6836e4d443d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.113950 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d91ffc-1907-4636-96f5-b6836e4d443d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.114235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d91ffc-1907-4636-96f5-b6836e4d443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.163733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:07.182163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-28d91ffc-1907-4636-96f5-b6836e4d443d None None] MFA Rules not processed for user `e085499376ee4a6e977eb8e66373d645`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:07.186706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-28d91ffc-1907-4636-96f5-b6836e4d443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:07.213566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c79ad-ec6a-48a9-9e8c-8e180650182d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.215183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c79ad-ec6a-48a9-9e8c-8e180650182d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.215183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c79ad-ec6a-48a9-9e8c-8e180650182d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.219273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 716/1435] 10.222.0.45 () {54 vars in 912 bytes} [Wed Oct 12 12:29:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:29:07.230807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.231247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.231890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.292503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] MFA Rules not processed for user `319b5538054c49d19ecc0b9c9cfc5b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:07.301488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:07.393738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 720/1436] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:07.394762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d91ffc-1907-4636-96f5-b6836e4d443d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:07.446722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 717/1437] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:07.489229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:07.492603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:07.510429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00b64c-3037-4969-b14a-84b3bf4240e7 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:07.522334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:07.525001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.525436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.527030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.546097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:07.550304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:07.552433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d91ffc-1907-4636-96f5-b6836e4d443d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:07.566997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:07.567918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.568247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.568679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.570231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:07.571825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:07.576264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 718/1438] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:07.687390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:07.696876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 721/1439] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:07 2022] POST /identity/v3/projects => generated 379 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:07.713084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121baff-9ab0-47e3-8e0c-0870c3c5d751 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:07.755395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:07.757435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:07.918644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:07.919425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.919694 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.921031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166ce0c-4738-4f68-a189-7d111d88f434 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:07.922359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.923061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:07.929593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:07.937366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced7f02-96a8-40c8-af72-32c52e20d897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:07.938117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced7f02-96a8-40c8-af72-32c52e20d897 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:07.938501 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced7f02-96a8-40c8-af72-32c52e20d897 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:07.938824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced7f02-96a8-40c8-af72-32c52e20d897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:07.945614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4ced7f02-96a8-40c8-af72-32c52e20d897 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:08.003019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 719/1440] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:07 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:08.004262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:08.019754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b633d76-468c-46b7-82de-869df585f5e4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:08.026701 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:08.027720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:08.028219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:08.028868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:08.030307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:08.035541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:08.051480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 720/1441] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:08.055635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:08.080151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85c04d-805c-4d2f-94d8-e990062310b2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:08.081830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:08.103031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:08.103503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:08.103824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:08.104097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] PATH_INFO: `/v3/projects/8eda39e2805d42638e1e991415dfc4db/users/38274c04aff648fdb436b5582794e74c/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:08.146190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eda39e2805d42638e1e991415dfc4db, user_id=38274c04aff648fdb436b5582794e74c, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:08.151590 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:08.160688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced7f02-96a8-40c8-af72-32c52e20d897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:08.162472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced7f02-96a8-40c8-af72-32c52e20d897 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:08.197524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 721/1442] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:08 2022] PUT /identity/v3/projects/8eda39e2805d42638e1e991415dfc4db/users/38274c04aff648fdb436b5582794e74c/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:08.201326 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:08.213473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 722/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:08.217719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:08.366641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae356d1-c5cd-4bdf-b9a9-d5f85ebb4c28 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:08.375971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:08.376269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:08.376564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:08.383736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:08.384583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:08.385124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:08.385532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:08.386339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:08.388147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:08.418118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 722/1444] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:08.419051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:08.448481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580f1f7-a3d1-442c-866c-ef9823fdb768 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:08.453110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3015a-1e05-43d4-b9ee-0fa9dd468b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:08.453956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3015a-1e05-43d4-b9ee-0fa9dd468b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:08.454237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3015a-1e05-43d4-b9ee-0fa9dd468b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:08.454509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3015a-1e05-43d4-b9ee-0fa9dd468b08 admin admin] PATH_INFO: `/v3/projects/8eda39e2805d42638e1e991415dfc4db/users/38274c04aff648fdb436b5582794e74c/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:08.462578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3015a-1e05-43d4-b9ee-0fa9dd468b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eda39e2805d42638e1e991415dfc4db, user_id=38274c04aff648fdb436b5582794e74c, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:08.468623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3015a-1e05-43d4-b9ee-0fa9dd468b08 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:08.514153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 723/1445] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:08 2022] PUT /identity/v3/projects/8eda39e2805d42638e1e991415dfc4db/users/38274c04aff648fdb436b5582794e74c/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:08.527540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:08.527898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:08.528139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:08.548187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:08.551727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:08.620250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] MFA Rules not processed for user `38274c04aff648fdb436b5582794e74c`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:08.622205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:08.789367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 724/1446] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:08.790861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:08.792526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:08.811632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 723/1447] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:08.812619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:08.818976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:09.019478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984bbd8-5c00-4858-8539-23795bb0fb2e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:09.029474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08655c-da39-4b18-a104-8481dc53b91c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:09.030339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08655c-da39-4b18-a104-8481dc53b91c service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:09.030759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08655c-da39-4b18-a104-8481dc53b91c service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:09.031340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08655c-da39-4b18-a104-8481dc53b91c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:09.053522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08655c-da39-4b18-a104-8481dc53b91c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:09.057060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f0b1d-44ac-42e1-8ffb-e81644ecf7f6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:09.057410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08655c-da39-4b18-a104-8481dc53b91c service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:09.071068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:09.071926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:09.072207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:09.072489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] PATH_INFO: `/v3/projects/bb099b44865d458f990613efd03d1132` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:09.074291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb099b44865d458f990613efd03d1132)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:09.076264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:09.084309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 724/1448] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:09.087219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:09.087547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:09.087788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:09.118515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:09.176322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] MFA Rules not processed for user `b11bb4a919764cb58b5dc1aba253677f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:09.177653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:09.188685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb099b44865d458f990613efd03d1132', 'request_id': 'req-2bc0055d-a375-4a21-b024-688eb1466acf'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:09.207702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb099b44865d458f990613efd03d1132', 'request_id': 'req-2bc0055d-a375-4a21-b024-688eb1466acf'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:09.230531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb099b44865d458f990613efd03d1132', 'request_id': 'req-2bc0055d-a375-4a21-b024-688eb1466acf'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:09.257145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] The token cache is being invalidate because project bb099b44865d458f990613efd03d1132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:09.257432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:09.261137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:09.265151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 725/1449] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:08 2022] DELETE /identity/v3/projects/bb099b44865d458f990613efd03d1132 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:09.265515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:09.271228 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:09.322114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:09.394640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 725/1450] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:09.399554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:09.405718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:09.474499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0055d-a375-4a21-b024-688eb1466acf admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:09.481528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29caeb-0b21-4f7d-9bd3-2e9025fd804d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:09.482478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29caeb-0b21-4f7d-9bd3-2e9025fd804d service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:09.483097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29caeb-0b21-4f7d-9bd3-2e9025fd804d service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:09.483470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29caeb-0b21-4f7d-9bd3-2e9025fd804d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:09.485507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7c29caeb-0b21-4f7d-9bd3-2e9025fd804d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:09.546240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda86dc-1587-4d15-be5a-2536372d7e49 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:09.555875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:09.557644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:09.557938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:09.558217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:09.562799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:09.615299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29caeb-0b21-4f7d-9bd3-2e9025fd804d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:09.617143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29caeb-0b21-4f7d-9bd3-2e9025fd804d service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:09.638275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 726/1451] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:29:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:29:09.640524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d84cea-7f0e-45b6-b170-268c6700c56c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:09.640920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d84cea-7f0e-45b6-b170-268c6700c56c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:09.641687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d84cea-7f0e-45b6-b170-268c6700c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:09.730872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-94d84cea-7f0e-45b6-b170-268c6700c56c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:09.734630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-94d84cea-7f0e-45b6-b170-268c6700c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:09.854389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:09.858673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:09.867084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:09.905908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 726/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:09.909938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:09.913547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:10.023386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 727/1453] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:10.031514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d9316-9393-4bf7-bc85-175dd2b9725d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:10.032000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d9316-9393-4bf7-bc85-175dd2b9725d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:10.032388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d9316-9393-4bf7-bc85-175dd2b9725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:10.089409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-aa4d9316-9393-4bf7-bc85-175dd2b9725d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:10.092848 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-aa4d9316-9393-4bf7-bc85-175dd2b9725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:10.117501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 728/1454] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:10.119494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d9316-9393-4bf7-bc85-175dd2b9725d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:10.179395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d9316-9393-4bf7-bc85-175dd2b9725d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:10.189050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca147fb7-acb0-4d56-a128-3d89fba3f5bb service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:10.208272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:10.209566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:10.210118 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:10.210402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:10.210678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:10.212199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:10.221239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:10.221796 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:10.225769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:10.226189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:10.230280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:10.232798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:10.247943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:10.311368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 727/1455] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:09 2022] POST /identity/v3/projects => generated 405 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:10.323004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:10.327409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 729/1456] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:10.339928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:10.387248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:10.400948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a6f3a-a310-42a2-b0ce-dfd30e268a44 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:10.447895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646542-dc2c-4877-9131-e0900af67602 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:10.456286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:10.457379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:10.457978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:10.458515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:10.459385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:10.462331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:10.503927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 728/1457] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:10 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:10.509294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:10.535307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a875db-2fb6-4619-a245-755c63b52929 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:10.544448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:10.545813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:10.546195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:10.546537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:10.547399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:10.550623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:10.579017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 729/1458] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:10.592922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:10.634805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2c08-e13b-4258-8b28-e58061baeffe admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:10.645058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:10.646214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:10.647192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:10.647403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] PATH_INFO: `/v3/projects/e21c6498a6644a73a28d8452c16b523d/users/72232c6d719b450ebb198f240fe050f9/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:10.679561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21c6498a6644a73a28d8452c16b523d, user_id=72232c6d719b450ebb198f240fe050f9, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:10.683462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:10.712016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 730/1459] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:10 2022] PUT /identity/v3/projects/e21c6498a6644a73a28d8452c16b523d/users/72232c6d719b450ebb198f240fe050f9/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:10.717047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:10.794604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:10.795353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:10.795528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:10.795824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:10.796476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:10.798420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:10.930191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 730/1460] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:10 2022] POST /identity/v3/projects => generated 381 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:10.931540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:11.086176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59c61-b9af-4eb7-8f87-be8d58f81d9a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:11.089940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b5bf4-7cce-4945-9e44-0825ce98f68c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:11.093577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:11.095031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.095290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.096343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.097593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:11.101412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:11.109196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:11.109834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.110113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.110383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.111037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:11.113627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:11.160497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 731/1461] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:11.161492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:11.193951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deac5f-6498-4885-ae1a-50ce8a85db41 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:11.199657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 731/1462] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:10 2022] POST /identity/v3/users => generated 291 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:11.205327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f2643-e207-4252-ba9f-f966c326c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:11.205684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:11.210167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2643-e207-4252-ba9f-f966c326c290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.210167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2643-e207-4252-ba9f-f966c326c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.210167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2643-e207-4252-ba9f-f966c326c290 admin admin] PATH_INFO: `/v3/projects/e21c6498a6644a73a28d8452c16b523d/users/72232c6d719b450ebb198f240fe050f9/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.212737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2643-e207-4252-ba9f-f966c326c290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21c6498a6644a73a28d8452c16b523d, user_id=72232c6d719b450ebb198f240fe050f9, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:11.215547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2643-e207-4252-ba9f-f966c326c290 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:11.235869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9720-b0a5-4c60-ab1a-4a28036d541c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:11.244884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:11.246385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.246803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.247141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.248046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:11.250031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:11.267068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 732/1463] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:11 2022] PUT /identity/v3/projects/e21c6498a6644a73a28d8452c16b523d/users/72232c6d719b450ebb198f240fe050f9/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:11.268637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a5e6-1aca-475a-9c90-5eface1498e4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.268973 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a5e6-1aca-475a-9c90-5eface1498e4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.269260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a5e6-1aca-475a-9c90-5eface1498e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.317146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 732/1464] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:11.318250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:11.328326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bf65a5e6-1aca-475a-9c90-5eface1498e4 None None] MFA Rules not processed for user `319b5538054c49d19ecc0b9c9cfc5b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:11.332383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bf65a5e6-1aca-475a-9c90-5eface1498e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:11.371312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932484-bdcb-499a-9767-6c5db58aa4dd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:11.389374 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:11.488722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 733/1465] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Oct 12 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:11.501027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20652d-2e1c-455f-a2ef-fc3c0ff345b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:11.501769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20652d-2e1c-455f-a2ef-fc3c0ff345b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.502243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20652d-2e1c-455f-a2ef-fc3c0ff345b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.502617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20652d-2e1c-455f-a2ef-fc3c0ff345b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.503342 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20652d-2e1c-455f-a2ef-fc3c0ff345b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:11.505471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20652d-2e1c-455f-a2ef-fc3c0ff345b5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:11.523477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 733/1466] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:11.527399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65a5e6-1aca-475a-9c90-5eface1498e4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:11.591842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65a5e6-1aca-475a-9c90-5eface1498e4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:11.605473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:11.606164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.606445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.606723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] PATH_INFO: `/v3/projects/f4b662f8685d459b8053af51e2f0400f/users/06212b00f13e4ca3bc56b29042699432/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.617265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:11.650173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b662f8685d459b8053af51e2f0400f, user_id=06212b00f13e4ca3bc56b29042699432, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:11.656449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:11.689861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 734/1467] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:11 2022] PUT /identity/v3/projects/f4b662f8685d459b8053af51e2f0400f/users/06212b00f13e4ca3bc56b29042699432/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:11.692382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412b1f-e046-4c7a-8ee3-5a2c80452a4e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:11.692789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412b1f-e046-4c7a-8ee3-5a2c80452a4e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:11.693172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412b1f-e046-4c7a-8ee3-5a2c80452a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:11.737474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-28412b1f-e046-4c7a-8ee3-5a2c80452a4e None None] MFA Rules not processed for user `06212b00f13e4ca3bc56b29042699432`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:11.739861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-28412b1f-e046-4c7a-8ee3-5a2c80452a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:11.859237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 734/1468] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:11.865281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:12.152573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a2d0e-e4c4-4b01-b539-53091930ce80 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:12.184471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:12.185154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:12.185538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:12.185913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:12.188563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:12.191208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:12.281314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 735/1469] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:11 2022] POST /identity/v3/projects => generated 379 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:12.285518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412b1f-e046-4c7a-8ee3-5a2c80452a4e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:12.303928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412b1f-e046-4c7a-8ee3-5a2c80452a4e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:12.486066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:12.508951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:12.510919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:12.517629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:12.520128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:12.525004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:12.648330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:12.648448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 735/1470] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:12 2022] POST /identity/v3/users => generated 296 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:12.662769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf84dc-09c6-4933-8b4d-826c10b647db admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:12.681372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:12.696072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:12.696072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:12.696072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:12.696072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:12.696072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:12.727996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 736/1471] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:12.731137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:12.781394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a13872-0811-4784-9fd7-9a9499bd024b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:12.792894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:12.799405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:12.799708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:12.800019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] PATH_INFO: `/v3/projects/32dfa14006f140dea0e7a231388a45b7/users/66e73881ebec41cbb1c636900de55dc4/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:12.826377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dfa14006f140dea0e7a231388a45b7, user_id=66e73881ebec41cbb1c636900de55dc4, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:12.852842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:12.854858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:12.868231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:12.916701 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:12.956151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 736/1472] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:12 2022] PUT /identity/v3/projects/32dfa14006f140dea0e7a231388a45b7/users/66e73881ebec41cbb1c636900de55dc4/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:12.959934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:13.010170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098d26-be48-48ec-82de-8d0b6a5e816d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:13.153431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:13.155629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:13.156151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:13.159020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:13.180077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:13.183194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:13.218210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 737/1473] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:13.255018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080003-e6a7-49a9-863e-a09e376bc09e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:13.270745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9f143-7cf2-4ba8-a755-9ca276ef5bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:13.271539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f143-7cf2-4ba8-a755-9ca276ef5bff admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:13.271844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f143-7cf2-4ba8-a755-9ca276ef5bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:13.272151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f143-7cf2-4ba8-a755-9ca276ef5bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:13.272767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9f143-7cf2-4ba8-a755-9ca276ef5bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:13.277745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9f143-7cf2-4ba8-a755-9ca276ef5bff admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:13.303570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 737/1474] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:13.307630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:13.328033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40098f8-2d8f-4fa8-9201-6f4a4bcdccc6 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:13.344510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:13.345185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:13.345470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:13.345745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] PATH_INFO: `/v3/projects/32dfa14006f140dea0e7a231388a45b7/users/66e73881ebec41cbb1c636900de55dc4/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:13.366644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dfa14006f140dea0e7a231388a45b7, user_id=66e73881ebec41cbb1c636900de55dc4, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:13.408108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:13.485251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 738/1475] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:13 2022] PUT /identity/v3/projects/32dfa14006f140dea0e7a231388a45b7/users/66e73881ebec41cbb1c636900de55dc4/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:13.492261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:13.492553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:13.492856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:13.573396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] MFA Rules not processed for user `66e73881ebec41cbb1c636900de55dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:13.577632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:13.761034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:13.763068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:13.766855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 738/1476] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:13.770696 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:13.784946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:13.794096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:13.967569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33bc9a-5a58-4582-85e6-b9be1a429819 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:13.978597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:13.979331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:13.979851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:13.980244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] PATH_INFO: `/v3/users/99e9ccf99b284f91a5238fb80b68c822` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:13.987212 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e9ccf99b284f91a5238fb80b68c822)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:13.993781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:14.052275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7565462-77a2-4b13-bd8e-e53067b19b64 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:14.067272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef083-96f5-4e8a-8803-b629a3ec2eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:14.073095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef083-96f5-4e8a-8803-b629a3ec2eab service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:14.073492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef083-96f5-4e8a-8803-b629a3ec2eab service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:14.076608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef083-96f5-4e8a-8803-b629a3ec2eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:14.102324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e9ccf99b284f91a5238fb80b68c822'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:14.103496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e9ccf99b284f91a5238fb80b68c822'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:14.103851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef083-96f5-4e8a-8803-b629a3ec2eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:14.106216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef083-96f5-4e8a-8803-b629a3ec2eab service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:14.129416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e9ccf99b284f91a5238fb80b68c822'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:14.129916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 739/1477] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:14.130631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e9ccf99b284f91a5238fb80b68c822'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:14.163429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e9ccf99b284f91a5238fb80b68c822'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:14.209289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 739/1478] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:13 2022] DELETE /identity/v3/users/99e9ccf99b284f91a5238fb80b68c822 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:14.222693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:14.223264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:14.223692 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:14.341805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:14.343461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:14.399328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:14.522665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 740/1479] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:14.533549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:14.535791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:14.784566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b35950-77dd-4e49-be4d-1d5571526566 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:14.794868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ad299-b302-4665-80fd-c4c9d7296eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:14.795510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad299-b302-4665-80fd-c4c9d7296eaa service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:14.795823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad299-b302-4665-80fd-c4c9d7296eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:14.796091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad299-b302-4665-80fd-c4c9d7296eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:14.802862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:14.806319 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:14.829968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ad299-b302-4665-80fd-c4c9d7296eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:14.833310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ad299-b302-4665-80fd-c4c9d7296eaa service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:14.839478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ad227-ad0d-4b8d-82ba-34b52c8bb729 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:14.863865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 740/1480] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:14.876865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:14.878281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:14.878570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:14.878849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] PATH_INFO: `/v3/users/e3de779b117e45e6ab92f9cd44cf9246` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:14.881606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3de779b117e45e6ab92f9cd44cf9246)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:14.883893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:14.991630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3de779b117e45e6ab92f9cd44cf9246'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:14.993383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3de779b117e45e6ab92f9cd44cf9246'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.023032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3de779b117e45e6ab92f9cd44cf9246'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.023842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3de779b117e45e6ab92f9cd44cf9246'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.036673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-844cd2e2-9bb4-4319-9e91-88816b43a5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3de779b117e45e6ab92f9cd44cf9246'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.057528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:15.058007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:15.058499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:15.089951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 741/1481] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:14 2022] DELETE /identity/v3/users/e3de779b117e45e6ab92f9cd44cf9246 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:15.092311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:15.092608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:15.092886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:15.163279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] MFA Rules not processed for user `72232c6d719b450ebb198f240fe050f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:15.164772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:15.181100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:15.184509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:15.193469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:15.370729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 741/1482] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:15.375168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:15.378349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:15.468282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 742/1483] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:15.634965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471a3a-909a-4738-9af0-2388ee64c6d8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:15.640940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:15.642415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:15.646163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:15.654177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:15.654496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:15.654777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] PATH_INFO: `/v3/users/06212b00f13e4ca3bc56b29042699432` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:15.662964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06212b00f13e4ca3bc56b29042699432)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:15.667313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:15.766792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:15.837247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422f9d-73ba-45c8-8433-b22e2f5cca4c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:15.845897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cea6e7-c1d3-43c6-91b6-3ece09cdf282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:15.847152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea6e7-c1d3-43c6-91b6-3ece09cdf282 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:15.847467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea6e7-c1d3-43c6-91b6-3ece09cdf282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:15.851839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea6e7-c1d3-43c6-91b6-3ece09cdf282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:15.855071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06212b00f13e4ca3bc56b29042699432'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.857213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06212b00f13e4ca3bc56b29042699432'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.879935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cea6e7-c1d3-43c6-91b6-3ece09cdf282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:15.881033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06212b00f13e4ca3bc56b29042699432'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.881411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cea6e7-c1d3-43c6-91b6-3ece09cdf282 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:15.882228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06212b00f13e4ca3bc56b29042699432'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.923744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06212b00f13e4ca3bc56b29042699432'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:15.930200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 743/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:15.964650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 742/1485] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:15 2022] DELETE /identity/v3/users/06212b00f13e4ca3bc56b29042699432 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:15.969165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:15.970955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:15.970955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:16.041413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:16.051612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:16.218919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 744/1486] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:16.282275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:16.285367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:16.359434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:16.439188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039c49-a6bb-4f13-a799-c2f32ba83770 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:16.449279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:16.458383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:16.458999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:16.459292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:16.549914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:16.556465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:16.611405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 743/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:17.823331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:17.824937 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:17.846512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421f65-aa89-4571-a2b6-ad99a1c612cc None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:17.860544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:17.864011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:17.864303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:17.864587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] PATH_INFO: `/v3/projects/62ee9d319879462c8248091062f5d1ba` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:17.869286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ee9d319879462c8248091062f5d1ba)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:17.874685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:18.029819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ee9d319879462c8248091062f5d1ba', 'request_id': 'req-b5c8efbd-fcc9-4c36-988b-28f9e005e827'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.044589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ee9d319879462c8248091062f5d1ba', 'request_id': 'req-b5c8efbd-fcc9-4c36-988b-28f9e005e827'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.079038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ee9d319879462c8248091062f5d1ba', 'request_id': 'req-b5c8efbd-fcc9-4c36-988b-28f9e005e827'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.089581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:18.091191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:18.148873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] The token cache is being invalidate because project 62ee9d319879462c8248091062f5d1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:18.148873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.148873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.149339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2beff-97fd-4bdd-8bf8-ee5738ae50f7 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:18.151929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 745/1488] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:17 2022] DELETE /identity/v3/projects/62ee9d319879462c8248091062f5d1ba => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:18.153053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:18.157008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:18.289678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:18.291037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:18.291315 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:18.291587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] PATH_INFO: `/v3/projects/f4b662f8685d459b8053af51e2f0400f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:18.293131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b662f8685d459b8053af51e2f0400f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:18.295715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:18.337702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8efbd-fcc9-4c36-988b-28f9e005e827 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:18.344626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:18.345950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:18.346804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:18.347253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] PATH_INFO: `/v3/users/54bd5e3bfe7243faa7de80315f627289` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:18.348989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bd5e3bfe7243faa7de80315f627289)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:18.351199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:18.357827 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:18.441488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b662f8685d459b8053af51e2f0400f', 'request_id': 'req-ad0f7a90-a3ec-456d-950b-73116ea44f02'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.466353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bd5e3bfe7243faa7de80315f627289'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.469538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bd5e3bfe7243faa7de80315f627289'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.470059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b662f8685d459b8053af51e2f0400f', 'request_id': 'req-ad0f7a90-a3ec-456d-950b-73116ea44f02'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.493537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b662f8685d459b8053af51e2f0400f', 'request_id': 'req-ad0f7a90-a3ec-456d-950b-73116ea44f02'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.513688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] The token cache is being invalidate because project f4b662f8685d459b8053af51e2f0400f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:18.514200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.515704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.521094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 744/1489] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:18 2022] DELETE /identity/v3/projects/f4b662f8685d459b8053af51e2f0400f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:18.522401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:18.522638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bd5e3bfe7243faa7de80315f627289'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.523206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bd5e3bfe7243faa7de80315f627289'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.524988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:18.543115 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bd5e3bfe7243faa7de80315f627289'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.564334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 746/1490] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:18 2022] DELETE /identity/v3/users/54bd5e3bfe7243faa7de80315f627289 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:18.564334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:18.564334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:18.641751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7a90-a3ec-456d-950b-73116ea44f02 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:18.647547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:18.704192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1311125-e425-448b-a1c0-5230902923a3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:18.720513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:18.721476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:18.721760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:18.722065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] PATH_INFO: `/v3/users/66e73881ebec41cbb1c636900de55dc4` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:18.724140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e73881ebec41cbb1c636900de55dc4)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:18.726084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:18.800154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:18.800859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:18.801142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:18.801461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] PATH_INFO: `/v3/projects/0791965fe60848ff851fd7d99d5d7e9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:18.802680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0791965fe60848ff851fd7d99d5d7e9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:18.804782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:18.873938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e73881ebec41cbb1c636900de55dc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.876831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e73881ebec41cbb1c636900de55dc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.923189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e73881ebec41cbb1c636900de55dc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.925373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e73881ebec41cbb1c636900de55dc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.942955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0791965fe60848ff851fd7d99d5d7e9b', 'request_id': 'req-cd1bea55-49ed-4f71-b448-fc0251ec238d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.943564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e73881ebec41cbb1c636900de55dc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.967199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0791965fe60848ff851fd7d99d5d7e9b', 'request_id': 'req-cd1bea55-49ed-4f71-b448-fc0251ec238d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:18.981785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 747/1491] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:18 2022] DELETE /identity/v3/users/66e73881ebec41cbb1c636900de55dc4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:18.981995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0791965fe60848ff851fd7d99d5d7e9b', 'request_id': 'req-cd1bea55-49ed-4f71-b448-fc0251ec238d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.009718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] The token cache is being invalidate because project 0791965fe60848ff851fd7d99d5d7e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:19.012210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.014367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-cd1bea55-49ed-4f71-b448-fc0251ec238d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.018726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 745/1492] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:18 2022] DELETE /identity/v3/projects/0791965fe60848ff851fd7d99d5d7e9b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:19.023311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:19.025110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:19.032046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:19.222773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53617f89-e8bf-4f8a-9ab4-b1822787a3a1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:19.236791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:19.237784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:19.238074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:19.238424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] PATH_INFO: `/v3/users/e085499376ee4a6e977eb8e66373d645` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:19.241545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e085499376ee4a6e977eb8e66373d645)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:19.244755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:19.351138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e085499376ee4a6e977eb8e66373d645'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.352160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e085499376ee4a6e977eb8e66373d645'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.384866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e085499376ee4a6e977eb8e66373d645'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.386403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e085499376ee4a6e977eb8e66373d645'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.408688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ef70e4fb-646f-44cc-a548-95694ea439b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e085499376ee4a6e977eb8e66373d645'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:19.437654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 748/1493] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:19 2022] DELETE /identity/v3/users/e085499376ee4a6e977eb8e66373d645 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:19.637340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c03b-a0db-4dcf-8fce-fe3136e934d1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:19.638037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c03b-a0db-4dcf-8fce-fe3136e934d1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:19.638218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c03b-a0db-4dcf-8fce-fe3136e934d1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:19.640719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 746/1494] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:29:19.674620 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:19.674912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:19.675197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:19.709559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:19.710864 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:19.829532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e66e-6aac-480f-ad35-72ac5fc560e1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:19.829532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e66e-6aac-480f-ad35-72ac5fc560e1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:19.829532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e66e-6aac-480f-ad35-72ac5fc560e1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:19.830308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 747/1495] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:29:19.844648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 749/1496] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:29:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:19.974705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:19.975719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:19.976302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:20.049707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:20.053148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:20.057612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:20.059336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:20.102421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b418c6-c8df-433f-b3ac-17bcdad15fd0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:20.123809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:20.124907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:20.126975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:20.132705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:20.166660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:20.168706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:20.220128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 750/1497] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:20.264966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 748/1498] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:29:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:20.692212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:20.693457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:20.710439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:20.721316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef879bc-6089-4e53-be3b-f932b25e2e1d service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:20.733873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f2f96-1c5c-48d0-bc51-23acf293834f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:20.734876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f2f96-1c5c-48d0-bc51-23acf293834f service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:20.735506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f2f96-1c5c-48d0-bc51-23acf293834f service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:20.736001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f2f96-1c5c-48d0-bc51-23acf293834f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:20.785880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f2f96-1c5c-48d0-bc51-23acf293834f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:20.790294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f2f96-1c5c-48d0-bc51-23acf293834f service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:20.822135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 751/1499] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:21.108237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:21.110378 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:21.210798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:21.310500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acf12e-51a4-4130-923f-5e6d216bf7d5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:21.329796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:21.330483 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:21.330736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:21.331012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] PATH_INFO: `/v3/projects/27603d81181f41da81005a07a9c5da16` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:21.332800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27603d81181f41da81005a07a9c5da16)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:21.334824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:21.477527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27603d81181f41da81005a07a9c5da16', 'request_id': 'req-a63fa258-ff52-4e75-9460-4a9ae0dd9816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.510291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27603d81181f41da81005a07a9c5da16', 'request_id': 'req-a63fa258-ff52-4e75-9460-4a9ae0dd9816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.528949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27603d81181f41da81005a07a9c5da16', 'request_id': 'req-a63fa258-ff52-4e75-9460-4a9ae0dd9816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.554270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] The token cache is being invalidate because project 27603d81181f41da81005a07a9c5da16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:21.554692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.555778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a63fa258-ff52-4e75-9460-4a9ae0dd9816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.559323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 749/1500] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:21 2022] DELETE /identity/v3/projects/27603d81181f41da81005a07a9c5da16 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:21.564637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:21.565575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:21.566131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:21.590861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:21.592687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:21.742946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 752/1501] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:21.759885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496ccdc-283d-4b93-9c8c-cd2d98e88a9f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:21.759885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496ccdc-283d-4b93-9c8c-cd2d98e88a9f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:21.759885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496ccdc-283d-4b93-9c8c-cd2d98e88a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:21.774771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:21.778759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:21.802920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ae3f8-268b-4aff-9284-6e8ff2fbb601 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:21.806615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4496ccdc-283d-4b93-9c8c-cd2d98e88a9f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:21.807830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4496ccdc-283d-4b93-9c8c-cd2d98e88a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:21.820035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 750/1502] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:21.824157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496ccdc-283d-4b93-9c8c-cd2d98e88a9f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:21.825758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:21.826476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:21.826771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:21.827041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] PATH_INFO: `/v3/projects/32dfa14006f140dea0e7a231388a45b7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:21.828266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32dfa14006f140dea0e7a231388a45b7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:21.830613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:21.858553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496ccdc-283d-4b93-9c8c-cd2d98e88a9f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:21.865188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:21.866203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:21.866510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:21.866764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:21.867820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:21.868138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:21.871177 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:21.898666 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 751/1503] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:21.900567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:21.925562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedff15b-6272-4c77-9991-2376cea985c7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:21.933727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32dfa14006f140dea0e7a231388a45b7', 'request_id': 'req-b0db250a-eef3-47c6-a692-a7f8bc0f433f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.949210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32dfa14006f140dea0e7a231388a45b7', 'request_id': 'req-b0db250a-eef3-47c6-a692-a7f8bc0f433f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.966149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32dfa14006f140dea0e7a231388a45b7', 'request_id': 'req-b0db250a-eef3-47c6-a692-a7f8bc0f433f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.993416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] The token cache is being invalidate because project 32dfa14006f140dea0e7a231388a45b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:21.993828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.996585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:21.998300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 753/1504] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:21 2022] DELETE /identity/v3/projects/32dfa14006f140dea0e7a231388a45b7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:21.999182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.003623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.083845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db250a-eef3-47c6-a692-a7f8bc0f433f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.097120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.097856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.098091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.098443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.099119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.100780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.101207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.102255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.102667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.103032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] PATH_INFO: `/v3/projects/0f26d520c4984c27966cbc0734378454` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.104606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f26d520c4984c27966cbc0734378454)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.107186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.128914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:22.141208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 752/1505] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:21 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:22.142204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.144157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.168139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f26d520c4984c27966cbc0734378454', 'request_id': 'req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.175227 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f26d520c4984c27966cbc0734378454', 'request_id': 'req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.181852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:22.185592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f26d520c4984c27966cbc0734378454', 'request_id': 'req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.198283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] The token cache is being invalidate because project 0f26d520c4984c27966cbc0734378454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:22.198727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.199386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d1e58fa9-bb56-4f38-b8fe-e4be8eea85dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.201024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 754/1506] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:21 2022] DELETE /identity/v3/projects/0f26d520c4984c27966cbc0734378454 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:22.202134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.202411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.202672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.222545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:22.223538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753caf8-e20d-41e9-879c-b0938447ef3e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.223729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.292996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.294047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.294476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.294955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] PATH_INFO: `/v3/users/b11bb4a919764cb58b5dc1aba253677f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.296463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11bb4a919764cb58b5dc1aba253677f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.298786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.307407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 755/1507] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:22.308899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.310390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.327360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e86c64-b441-4614-bfb7-de0bb244d54a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.341801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.342418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.342745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.342958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.343592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.346290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.356843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11bb4a919764cb58b5dc1aba253677f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.357543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11bb4a919764cb58b5dc1aba253677f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.365244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11bb4a919764cb58b5dc1aba253677f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.366198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11bb4a919764cb58b5dc1aba253677f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.379028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ef6b2e8a-b6df-40f2-bb44-3cb82482d599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11bb4a919764cb58b5dc1aba253677f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.383147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 756/1508] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:22 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:22.384912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.387755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.391310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 753/1509] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:22 2022] DELETE /identity/v3/users/b11bb4a919764cb58b5dc1aba253677f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:22.392572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b597526-b7f6-41ba-8af9-204baa9b2ec8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.392860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b597526-b7f6-41ba-8af9-204baa9b2ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.393132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b597526-b7f6-41ba-8af9-204baa9b2ec8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.394586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 754/1510] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:29:22.395789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.396094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.396368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.401057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928c4ec-c5b8-46c0-9ecc-947ab9f3d20f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.423082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:22.424633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.466681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.467504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.467879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.468229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] PATH_INFO: `/v3/users/38274c04aff648fdb436b5582794e74c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.469477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38274c04aff648fdb436b5582794e74c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.471543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.483272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:22.500239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 755/1511] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:22.501091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.505104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.513477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:22.520044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f9879-36d5-4d3c-ac57-1387a45c4498 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.526829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a20e2-7f4a-4b43-b79b-3c85f351be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.527257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a20e2-7f4a-4b43-b79b-3c85f351be63 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.527472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a20e2-7f4a-4b43-b79b-3c85f351be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.527774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a20e2-7f4a-4b43-b79b-3c85f351be63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.528580 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a20e2-7f4a-4b43-b79b-3c85f351be63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.530012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a20e2-7f4a-4b43-b79b-3c85f351be63 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.531902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38274c04aff648fdb436b5582794e74c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.532664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38274c04aff648fdb436b5582794e74c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.541390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 756/1512] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:22.549160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38274c04aff648fdb436b5582794e74c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.549910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38274c04aff648fdb436b5582794e74c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.563916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38274c04aff648fdb436b5582794e74c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.565428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bae-8980-450b-a52c-455b28408084 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.565730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bae-8980-450b-a52c-455b28408084 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.566058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bae-8980-450b-a52c-455b28408084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.596222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 757/1513] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:22 2022] DELETE /identity/v3/users/38274c04aff648fdb436b5582794e74c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:22.602907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.605093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.616274 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1d855bae-8980-450b-a52c-455b28408084 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:22.617503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1d855bae-8980-450b-a52c-455b28408084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.721248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb081de-3a19-4609-bc61-a28776b2e799 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.725354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 757/1514] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:22.726219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855bae-8980-450b-a52c-455b28408084 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.729244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1d855bae-8980-450b-a52c-455b28408084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.729943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.730794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.731199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.732135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.732807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:22.733258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.735144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.756200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 758/1515] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:22.757205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.759063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.763103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855bae-8980-450b-a52c-455b28408084 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.769183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.769949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.770230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.778636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.779577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.781595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.793685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb83d92-f22c-447a-b2a1-da8ed77e8c08 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.796757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 758/1516] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:22.797608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.805646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.809427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03067cf-cd8d-4eea-97af-ee07f022febf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:22.810289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.810940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.811361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] PATH_INFO: `/v3/projects/41bd09c8c5c74062ba48c7e314f27da1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.814527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:22.815329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bd09c8c5c74062ba48c7e314f27da1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.815442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:22.815629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:22.816094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:22.816799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:22.819133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.820732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:22.870918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 759/1517] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:22 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:22.871815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.874882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.909405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bd09c8c5c74062ba48c7e314f27da1', 'request_id': 'req-f9145a7e-6857-4303-9a7a-79d8241816a4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.921139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bd09c8c5c74062ba48c7e314f27da1', 'request_id': 'req-f9145a7e-6857-4303-9a7a-79d8241816a4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.934932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bd09c8c5c74062ba48c7e314f27da1', 'request_id': 'req-f9145a7e-6857-4303-9a7a-79d8241816a4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.966787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] The token cache is being invalidate because project 41bd09c8c5c74062ba48c7e314f27da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:22.967139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.969798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:22.972937 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 759/1518] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:22 2022] DELETE /identity/v3/projects/41bd09c8c5c74062ba48c7e314f27da1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:22.976789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:22.980605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:22.999470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e904de-5f75-4f14-bafe-5d640ad4f5e2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.034912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:23.094475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:23.107259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9145a7e-6857-4303-9a7a-79d8241816a4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.115459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.116406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.116786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.117164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] PATH_INFO: `/v3/projects/69b3b37a3d2d43a58e78cf7275b933c5/users/6981bf6bac0a4f37916382c621473981/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.136536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.138045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.138531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.139030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.141455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.156990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b3b37a3d2d43a58e78cf7275b933c5, user_id=6981bf6bac0a4f37916382c621473981, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.163044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.165067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.165634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.193549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 760/1519] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:23.195551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.202090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.213876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 760/1520] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:22 2022] PUT /identity/v3/projects/69b3b37a3d2d43a58e78cf7275b933c5/users/6981bf6bac0a4f37916382c621473981/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:23.214843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.220694 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.228280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba976854-a293-4efa-810b-ace0ae88693b service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.349489 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc772dfe-f4db-4f0d-9b51-7afbba29b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.350145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772dfe-f4db-4f0d-9b51-7afbba29b0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.350432 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772dfe-f4db-4f0d-9b51-7afbba29b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.351231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc772dfe-f4db-4f0d-9b51-7afbba29b0ff admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.352037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc772dfe-f4db-4f0d-9b51-7afbba29b0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.355619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc772dfe-f4db-4f0d-9b51-7afbba29b0ff admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.389032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd868-ea98-4358-b7eb-4dc5d7fee75f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.394493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 761/1521] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:23 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:23.394493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.394730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.394830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.394830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.395363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.395612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.395914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] PATH_INFO: `/v3/users/72232c6d719b450ebb198f240fe050f9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.397159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72232c6d719b450ebb198f240fe050f9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.399717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.430657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] MFA Rules not processed for user `6981bf6bac0a4f37916382c621473981`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:23.432627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.452822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72232c6d719b450ebb198f240fe050f9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.453524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72232c6d719b450ebb198f240fe050f9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.468787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72232c6d719b450ebb198f240fe050f9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.469514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72232c6d719b450ebb198f240fe050f9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.484625 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72232c6d719b450ebb198f240fe050f9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.522953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 761/1522] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:23 2022] DELETE /identity/v3/users/72232c6d719b450ebb198f240fe050f9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:23.530163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.535310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.556859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 762/1523] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:23.565780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.567841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.619380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:23.679857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b6457-a959-4a22-aaa1-d44d5a75de30 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.687414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.688626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.690059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.690583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.691426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.693358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.706438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 762/1524] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:23.711198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.717381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:23.726613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b6705-0bb4-4b9f-8e3f-c8af819ff916 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.733759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.734417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.734774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.735158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.736091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.738147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.738898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80fc7-52fe-4bef-8154-e9180cbe88b7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.756373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 763/1525] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:23.759728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.765078 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.789408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e4c9f-3ab0-4aa6-be49-4f09f878bab8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.795645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.796446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.796795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.797130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] PATH_INFO: `/v3/projects/8eda39e2805d42638e1e991415dfc4db` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.798454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eda39e2805d42638e1e991415dfc4db)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.800256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.831604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e2a4c-acc4-4b02-ac9e-3644cacd6951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.832270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2a4c-acc4-4b02-ac9e-3644cacd6951 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.832631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2a4c-acc4-4b02-ac9e-3644cacd6951 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.832907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2a4c-acc4-4b02-ac9e-3644cacd6951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.851931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eda39e2805d42638e1e991415dfc4db', 'request_id': 'req-67df8cbf-6409-4a46-89fb-6a97d38fc178'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.860038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eda39e2805d42638e1e991415dfc4db', 'request_id': 'req-67df8cbf-6409-4a46-89fb-6a97d38fc178'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.870381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eda39e2805d42638e1e991415dfc4db', 'request_id': 'req-67df8cbf-6409-4a46-89fb-6a97d38fc178'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.885627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] The token cache is being invalidate because project 8eda39e2805d42638e1e991415dfc4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:23.886160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.886861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:23.889456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 764/1526] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:23 2022] DELETE /identity/v3/projects/8eda39e2805d42638e1e991415dfc4db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:23.889658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.891021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.909118 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e2a4c-acc4-4b02-ac9e-3644cacd6951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:23.911220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e2a4c-acc4-4b02-ac9e-3644cacd6951 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:23.921768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 763/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:23.923084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.923445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.923785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:23.961572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:23.963817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.982737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df8cbf-6409-4a46-89fb-6a97d38fc178 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:23.984377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 764/1528] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:23.985773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:23.987405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:23.991464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24d80a-25cf-4a37-a6b6-778d5c399682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:23.992378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d80a-25cf-4a37-a6b6-778d5c399682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:23.992668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d80a-25cf-4a37-a6b6-778d5c399682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:23.993041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d80a-25cf-4a37-a6b6-778d5c399682 admin admin] PATH_INFO: `/v3/projects/97af7722a64a4bf489b41a8123b96a56/users/80d76042707948ff8274f01e914be24d/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.002500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225a16b-ae6a-4c32-ac98-58bce65521bf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.009198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d80a-25cf-4a37-a6b6-778d5c399682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97af7722a64a4bf489b41a8123b96a56, user_id=80d76042707948ff8274f01e914be24d, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.010338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.011070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.011423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.011765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] PATH_INFO: `/v3/projects/e21c6498a6644a73a28d8452c16b523d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.011953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d80a-25cf-4a37-a6b6-778d5c399682 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.012988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21c6498a6644a73a28d8452c16b523d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.014996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.027858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 765/1529] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:23 2022] PUT /identity/v3/projects/97af7722a64a4bf489b41a8123b96a56/users/80d76042707948ff8274f01e914be24d/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:24.033188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac172e-40ca-41f0-afcc-3815fc8be5e0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.033976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac172e-40ca-41f0-afcc-3815fc8be5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.034438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac172e-40ca-41f0-afcc-3815fc8be5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.061534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9dac172e-40ca-41f0-afcc-3815fc8be5e0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:24.063484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9dac172e-40ca-41f0-afcc-3815fc8be5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.067616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21c6498a6644a73a28d8452c16b523d', 'request_id': 'req-dc696594-7402-4d57-bf9c-128a64610395'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.076638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21c6498a6644a73a28d8452c16b523d', 'request_id': 'req-dc696594-7402-4d57-bf9c-128a64610395'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.080566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:24.085443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21c6498a6644a73a28d8452c16b523d', 'request_id': 'req-dc696594-7402-4d57-bf9c-128a64610395'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.107324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] The token cache is being invalidate because project e21c6498a6644a73a28d8452c16b523d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:24.108256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.109463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dc696594-7402-4d57-bf9c-128a64610395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.112284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 765/1530] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:23 2022] DELETE /identity/v3/projects/e21c6498a6644a73a28d8452c16b523d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:24.117029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d33f-dbdc-4934-b1ff-7cf5e91f1d9b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.117319 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d33f-dbdc-4934-b1ff-7cf5e91f1d9b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.117621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d33f-dbdc-4934-b1ff-7cf5e91f1d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.144819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 766/1531] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:24.146525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dd993-ebbd-4b3f-a2f6-6862702cc674 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.146799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dd993-ebbd-4b3f-a2f6-6862702cc674 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.147066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dd993-ebbd-4b3f-a2f6-6862702cc674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.150909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9ec1d33f-dbdc-4934-b1ff-7cf5e91f1d9b None None] MFA Rules not processed for user `80d76042707948ff8274f01e914be24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:24.152240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9ec1d33f-dbdc-4934-b1ff-7cf5e91f1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.172990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a14dd993-ebbd-4b3f-a2f6-6862702cc674 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:24.174188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a14dd993-ebbd-4b3f-a2f6-6862702cc674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.183016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 767/1532] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:24.184039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dd993-ebbd-4b3f-a2f6-6862702cc674 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.190563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:24.200229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dd993-ebbd-4b3f-a2f6-6862702cc674 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.216032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6a8b-3b74-42e0-bfbc-142932deaca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.216032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6a8b-3b74-42e0-bfbc-142932deaca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.216032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6a8b-3b74-42e0-bfbc-142932deaca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.216032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6a8b-3b74-42e0-bfbc-142932deaca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.216335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6a8b-3b74-42e0-bfbc-142932deaca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:24.216335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6a8b-3b74-42e0-bfbc-142932deaca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.216335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6a8b-3b74-42e0-bfbc-142932deaca3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.235760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 768/1533] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:24.237390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d99c-83c0-45e0-952b-82b09d4cad13 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.237687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d99c-83c0-45e0-952b-82b09d4cad13 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.237971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d99c-83c0-45e0-952b-82b09d4cad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.260103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2c62d99c-83c0-45e0-952b-82b09d4cad13 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:24.261386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2c62d99c-83c0-45e0-952b-82b09d4cad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.264321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 766/1534] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:24.265222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1d33f-dbdc-4934-b1ff-7cf5e91f1d9b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.272339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 769/1535] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:24.278244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62d99c-83c0-45e0-952b-82b09d4cad13 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.291890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1d33f-dbdc-4934-b1ff-7cf5e91f1d9b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.293610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62d99c-83c0-45e0-952b-82b09d4cad13 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.299504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.300266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.300547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.300865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.301865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.304179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.305475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.306134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.306503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.306785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.307667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:24.308007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.310746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.325608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 770/1536] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:24.326607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.328379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.353627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 767/1537] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:24.353627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.393351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d71b4-c106-4fb2-b1d7-e04390867747 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.428806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dc3b2-d15b-4eb8-ac76-d5801303503e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.433943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.434725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.435011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.435285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.435984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.438132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.453605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.454296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.454586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.454866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.472947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 768/1538] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:24.472947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.548150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:24.563639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a4b8-eb66-4e78-ac5c-363f71e72364 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.572755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.575694 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.575875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.577503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.578023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.578404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.580468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.583417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.600877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 771/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:24.604852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.633194 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aedf3-48fb-43cd-bc79-d154b3c8944a service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.638797 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 769/1540] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:24.640371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.648810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.651970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.654445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a896ff-aad2-42a1-8e1d-aa9ea0e7d12f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.655262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.655689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.656431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.658452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.676197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.677138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.677674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.678091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.679444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.683870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.688146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 772/1541] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/users => generated 282 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:24.689136 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.691482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.701031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 770/1542] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:24.702125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.713180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:24.718703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf635-a029-49f1-abcf-f73766445154 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.719894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee01bd3-988e-45d4-8283-c4b754cb16a2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.724437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.725086 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.725367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.725675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] PATH_INFO: `/v3/users/80d76042707948ff8274f01e914be24d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.726841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d76042707948ff8274f01e914be24d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.729176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.729802 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.729994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.730092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.730336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.731234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.733474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.752421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 771/1543] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:24.752421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.781462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932565-bf64-4c21-83c2-c76f7aec02bf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.793854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.794504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.794836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.795246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.796078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.799488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.802290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d76042707948ff8274f01e914be24d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.802981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d76042707948ff8274f01e914be24d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.815447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 772/1544] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:24.817846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.821331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d76042707948ff8274f01e914be24d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.821519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.822550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d76042707948ff8274f01e914be24d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.834567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d76042707948ff8274f01e914be24d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:24.853652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 773/1545] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:24 2022] DELETE /identity/v3/users/80d76042707948ff8274f01e914be24d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:24.854931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:24.856821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.858801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94324d64-53de-4019-9f7a-919ce0d3a08e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.950168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88d04a-3958-49dd-9660-cbe13fb7880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.951122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88d04a-3958-49dd-9660-cbe13fb7880a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.951413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88d04a-3958-49dd-9660-cbe13fb7880a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.951694 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88d04a-3958-49dd-9660-cbe13fb7880a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.953133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88d04a-3958-49dd-9660-cbe13fb7880a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:24.955112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88d04a-3958-49dd-9660-cbe13fb7880a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:24.966927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e562-89c5-4c6d-9896-52b1314bcdd0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:24.967136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 773/1546] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:24.968338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff20982-b9ed-40f8-998d-f5ca14ffe15b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.968703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff20982-b9ed-40f8-998d-f5ca14ffe15b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.968988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff20982-b9ed-40f8-998d-f5ca14ffe15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.974441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:24.975341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:24.975813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:24.976518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] PATH_INFO: `/v3/projects/2bbd25c208ca495baaad39749f344166/users/b5eeadf0e79f41c79a5538192a82b071/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:24.992388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8ff20982-b9ed-40f8-998d-f5ca14ffe15b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:24.994037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8ff20982-b9ed-40f8-998d-f5ca14ffe15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:24.994580 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbd25c208ca495baaad39749f344166, user_id=b5eeadf0e79f41c79a5538192a82b071, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.000443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.013060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 774/1547] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:25.013060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff20982-b9ed-40f8-998d-f5ca14ffe15b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.030306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff20982-b9ed-40f8-998d-f5ca14ffe15b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.036026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 774/1548] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:24 2022] PUT /identity/v3/projects/2bbd25c208ca495baaad39749f344166/users/b5eeadf0e79f41c79a5538192a82b071/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:25.036927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.044479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:25.082787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:25.120084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b563f37-1a79-4c16-8f4b-6a7af437f452 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.128417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8b24-089e-4a9e-9b8e-3cb7f464646b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.129402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8b24-089e-4a9e-9b8e-3cb7f464646b service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.129900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8b24-089e-4a9e-9b8e-3cb7f464646b service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.130252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8b24-089e-4a9e-9b8e-3cb7f464646b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.210947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8b24-089e-4a9e-9b8e-3cb7f464646b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.213058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8b24-089e-4a9e-9b8e-3cb7f464646b service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.235214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 775/1549] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:25.236894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.237185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.237460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.257593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726a9f-0b91-43c6-bca1-208d5d39fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.258938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726a9f-0b91-43c6-bca1-208d5d39fc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.259322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726a9f-0b91-43c6-bca1-208d5d39fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.259761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726a9f-0b91-43c6-bca1-208d5d39fc94 admin admin] PATH_INFO: `/v3/projects/eac56fe408f7442fbff44a5511cb81f0/users/135c90193455446c8e80379cbcf0414d/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.269718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] MFA Rules not processed for user `b5eeadf0e79f41c79a5538192a82b071`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:25.270951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:25.277092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726a9f-0b91-43c6-bca1-208d5d39fc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac56fe408f7442fbff44a5511cb81f0, user_id=135c90193455446c8e80379cbcf0414d, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.279879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726a9f-0b91-43c6-bca1-208d5d39fc94 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.295554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 775/1550] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:25 2022] PUT /identity/v3/projects/eac56fe408f7442fbff44a5511cb81f0/users/135c90193455446c8e80379cbcf0414d/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:25.308722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e51560-0f9e-40b7-bdf3-6569b1e9f0f9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.308999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e51560-0f9e-40b7-bdf3-6569b1e9f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.309442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e51560-0f9e-40b7-bdf3-6569b1e9f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.342794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e6e51560-0f9e-40b7-bdf3-6569b1e9f0f9 None None] MFA Rules not processed for user `135c90193455446c8e80379cbcf0414d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:25.345527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e6e51560-0f9e-40b7-bdf3-6569b1e9f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:25.384571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 776/1551] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:25.399411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.400370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:25.403341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:25.444010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 776/1552] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:25.448548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e51560-0f9e-40b7-bdf3-6569b1e9f0f9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.501666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490f48-55c1-4cd3-b715-d86f6d931aa2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.524343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:25.539943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e51560-0f9e-40b7-bdf3-6569b1e9f0f9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.555298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.556102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.556393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.556668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.557312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.559508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.570854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.572068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.572417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.572693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.599035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 777/1553] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:25 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:25.602563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.684643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.686532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434121d9-abce-4333-a1e6-6a79a26519e5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.686716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.691579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.692189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.692479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.692805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.693517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.695490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.717179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 777/1554] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:25.718168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.721720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 778/1555] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:25 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:25.722627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:25.729931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.739756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008a43-1128-4f55-a4e9-e3062fc968d2 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.742728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93df00-798f-471a-a327-528aca5d4966 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.748020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.749123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.749818 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.750264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] PATH_INFO: `/v3/projects/97af7722a64a4bf489b41a8123b96a56` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.752376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97af7722a64a4bf489b41a8123b96a56)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.761319 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.766060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.766831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.767031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.767271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.774437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.775240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.801922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 779/1556] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:25.803020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.826371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734b1e-567d-496f-a929-7a1da2708e80 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:25.845838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:25.846530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.846837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.847090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] PATH_INFO: `/v3/projects/29513d0068fb430b864185f797c8c7ae/users/d4e8b41629f1460baa96152a6da7b42c/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.874915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97af7722a64a4bf489b41a8123b96a56', 'request_id': 'req-412e3bcf-9f87-4b57-82b8-851d830cd352'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:25.877582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29513d0068fb430b864185f797c8c7ae, user_id=d4e8b41629f1460baa96152a6da7b42c, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:25.885137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:25.888505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97af7722a64a4bf489b41a8123b96a56', 'request_id': 'req-412e3bcf-9f87-4b57-82b8-851d830cd352'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:25.906888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97af7722a64a4bf489b41a8123b96a56', 'request_id': 'req-412e3bcf-9f87-4b57-82b8-851d830cd352'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:25.915496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 780/1557] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:25 2022] PUT /identity/v3/projects/29513d0068fb430b864185f797c8c7ae/users/d4e8b41629f1460baa96152a6da7b42c/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:25.919063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:25.936398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] The token cache is being invalidate because project 97af7722a64a4bf489b41a8123b96a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:25.936771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:25.940625 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-412e3bcf-9f87-4b57-82b8-851d830cd352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:25.944746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 778/1558] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:25 2022] DELETE /identity/v3/projects/97af7722a64a4bf489b41a8123b96a56 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:25.951356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffab3a-5b8d-41d9-a0ac-45eb64514343 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:25.952150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffab3a-5b8d-41d9-a0ac-45eb64514343 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:25.952677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffab3a-5b8d-41d9-a0ac-45eb64514343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:25.969984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:26.010341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c2ffab3a-5b8d-41d9-a0ac-45eb64514343 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:26.011585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c2ffab3a-5b8d-41d9-a0ac-45eb64514343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:26.020154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 779/1559] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:26.024086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d282d9-d34f-4ad3-b08e-81e53f91575d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.033657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.035012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.035012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.035463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.036532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.039023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.056062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 781/1560] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:26.058396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.060387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c933cf1-449c-4d82-becb-d2d15cca1f97 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.064593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:26.064831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c933cf1-449c-4d82-becb-d2d15cca1f97 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.065149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c933cf1-449c-4d82-becb-d2d15cca1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.118948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d297-311e-408c-8c1a-ed826c38da59 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.139686 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669b103-5d9d-4b5c-90ec-ebe646061462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.140412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b103-5d9d-4b5c-90ec-ebe646061462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.140723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b103-5d9d-4b5c-90ec-ebe646061462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.140975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b103-5d9d-4b5c-90ec-ebe646061462 admin admin] PATH_INFO: `/v3/projects/29513d0068fb430b864185f797c8c7ae/users/d4e8b41629f1460baa96152a6da7b42c/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.145360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1c933cf1-449c-4d82-becb-d2d15cca1f97 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:26.146597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1c933cf1-449c-4d82-becb-d2d15cca1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:26.152133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669b103-5d9d-4b5c-90ec-ebe646061462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29513d0068fb430b864185f797c8c7ae, user_id=d4e8b41629f1460baa96152a6da7b42c, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.156881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669b103-5d9d-4b5c-90ec-ebe646061462 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.189419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 780/1561] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:26.193401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c933cf1-449c-4d82-becb-d2d15cca1f97 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.206211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 782/1562] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:26 2022] PUT /identity/v3/projects/29513d0068fb430b864185f797c8c7ae/users/d4e8b41629f1460baa96152a6da7b42c/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:26.208866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c933cf1-449c-4d82-becb-d2d15cca1f97 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.228081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50224f34-29cd-4f50-b528-79c67baef035 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.228081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50224f34-29cd-4f50-b528-79c67baef035 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.228081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50224f34-29cd-4f50-b528-79c67baef035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.294989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-50224f34-29cd-4f50-b528-79c67baef035 None None] MFA Rules not processed for user `d4e8b41629f1460baa96152a6da7b42c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:26.297346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-50224f34-29cd-4f50-b528-79c67baef035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:26.321575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:26.356865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.357782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.358661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.380717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.382740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:26.383161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.385117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.426459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 781/1563] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:29:26.426753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 783/1564] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:26.428230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50224f34-29cd-4f50-b528-79c67baef035 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.436155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.438432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:26.447495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50224f34-29cd-4f50-b528-79c67baef035 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.458211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.460394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.461292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.461739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.462711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.464868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.519577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 784/1565] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:26 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:26.524579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.535175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9af29-c422-48cf-b56f-be8bc114f38d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.604296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d648aa9-b1fb-4364-9a76-c22d70348d93 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.609706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.610475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.610823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.611840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.615097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.615721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.616061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.616334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.616994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.618909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.638014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:26.644917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 785/1566] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:26 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:26.650175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.660082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45b24-297c-43fc-a6e6-0647fa1ff868 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.665155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.665845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.666156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.666431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.667102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.668761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.681944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 786/1567] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:26.682895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.686040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.687481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.692479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45325-9ff4-4636-9eb8-7347330aa5b9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.697677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.698268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.698544 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.698814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.699475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.700060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 782/1568] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:26.701256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.712887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 787/1569] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:26.717180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.730058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57646232-36db-4565-aa82-1c4b0d323055 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.740575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a443af7-bea4-42d7-bb3c-fa71004e1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.741784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443af7-bea4-42d7-bb3c-fa71004e1653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.742066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443af7-bea4-42d7-bb3c-fa71004e1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.742343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443af7-bea4-42d7-bb3c-fa71004e1653 admin admin] PATH_INFO: `/v3/projects/d4e0f0fc38514c09a0deda2191fd47a0/users/fcae7f830d03417b8dfedafc21928f9e/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.766717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443af7-bea4-42d7-bb3c-fa71004e1653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e0f0fc38514c09a0deda2191fd47a0, user_id=fcae7f830d03417b8dfedafc21928f9e, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:26.769576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443af7-bea4-42d7-bb3c-fa71004e1653 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:26.789515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:26.792394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 783/1570] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:26 2022] PUT /identity/v3/projects/d4e0f0fc38514c09a0deda2191fd47a0/users/fcae7f830d03417b8dfedafc21928f9e/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:26.802016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d0812-ed10-416a-b3c0-28dd2b96e59f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:26.803909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4dbd-03d7-4822-be1b-2db151c42822 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.804345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4dbd-03d7-4822-be1b-2db151c42822 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.804654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4dbd-03d7-4822-be1b-2db151c42822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.836871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e4be4dbd-03d7-4822-be1b-2db151c42822 None None] MFA Rules not processed for user `fcae7f830d03417b8dfedafc21928f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:26.844558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e4be4dbd-03d7-4822-be1b-2db151c42822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:26.850940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:26.869886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:26.870771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:26.871054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:26.871327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:26.873526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:26.931784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 784/1571] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:26.936358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4dbd-03d7-4822-be1b-2db151c42822 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:27.000112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:27.002628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:27.015679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 788/1572] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:27.072822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4dbd-03d7-4822-be1b-2db151c42822 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:27.089009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:27.089759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:27.090030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:27.090327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:27.090942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:27.093303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:27.173201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 785/1573] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:26 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:27.174399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:27.196988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b187f3-44d6-4a7a-b8d6-f2a700628b0f service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:27.339949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:27.340681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:27.343195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:27.343195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:27.343503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:27.348662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:27.395200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 789/1574] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:27 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:27.395964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:27.420093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c9998-5757-4e1d-8f88-24d72779714b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:27.435963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:27.436595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:27.436880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:27.437150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:27.437810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:27.441482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:27.453909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 786/1575] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:27.458017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:27.472943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d8b0c-1a75-41cf-b812-55e6773791c8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:27.484238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02845a88-e0dd-4a22-9501-137acfabf028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:27.484968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845a88-e0dd-4a22-9501-137acfabf028 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:27.485424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845a88-e0dd-4a22-9501-137acfabf028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:27.485768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845a88-e0dd-4a22-9501-137acfabf028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:27.486596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02845a88-e0dd-4a22-9501-137acfabf028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:27.489514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02845a88-e0dd-4a22-9501-137acfabf028 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:27.521749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 790/1576] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:27.525709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:27.540919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2253625-cd1d-4619-9816-e8540ec685ba admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:27.552144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:27.552872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:27.553159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:27.553443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] PATH_INFO: `/v3/projects/bc67b7bdf3a44322a8a5fbbcd5d0fea8/users/a089fa1588ae48cdbf7b7469b4fac235/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:27.587630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc67b7bdf3a44322a8a5fbbcd5d0fea8, user_id=a089fa1588ae48cdbf7b7469b4fac235, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:27.590532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:27.617382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 787/1577] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:27 2022] PUT /identity/v3/projects/bc67b7bdf3a44322a8a5fbbcd5d0fea8/users/a089fa1588ae48cdbf7b7469b4fac235/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:27.629674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6df7-39ee-4298-bf36-8babd488f692 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:27.629983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6df7-39ee-4298-bf36-8babd488f692 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:27.630249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6df7-39ee-4298-bf36-8babd488f692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:27.680055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:27.698920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ba4f6df7-39ee-4298-bf36-8babd488f692 None None] MFA Rules not processed for user `a089fa1588ae48cdbf7b7469b4fac235`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:27.700124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ba4f6df7-39ee-4298-bf36-8babd488f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:27.823697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 791/1578] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:27.828038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:27.934821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a2b51-c0ea-4311-b2c3-c9db174a7128 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:27.939996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:27.940637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:27.941470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:27.941470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:27.941814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:27.944336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:27.950802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:27.983835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 788/1579] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:27 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:27.986920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f6df7-39ee-4298-bf36-8babd488f692 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:28.006784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f6df7-39ee-4298-bf36-8babd488f692 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:28.072002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:28.072726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.073069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.073410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.074132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:28.076194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:28.099254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 792/1580] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:27 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:28.103044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:28.133907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31cc06-697e-41b0-be78-e07384cf7e9a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:28.139315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:28.140192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.140520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.140799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.141509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:28.143456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:28.159235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 789/1581] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:28.160246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:28.170956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb90c-4374-4357-8506-850b6f656fce admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:28.175497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:28.176191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.176472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.176766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] PATH_INFO: `/v3/projects/d1f37163f59a489e9247811465c7c40f/users/ff581a2f0d8349a59450ded8abfc5971/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.192891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f37163f59a489e9247811465c7c40f, user_id=ff581a2f0d8349a59450ded8abfc5971, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:28.195551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:28.211220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 793/1582] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:28 2022] PUT /identity/v3/projects/d1f37163f59a489e9247811465c7c40f/users/ff581a2f0d8349a59450ded8abfc5971/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:28.215245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:28.225034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefc2fe-bb23-439f-acd3-2052ac34c50c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:28.285832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd32dc-797a-48d0-8bbb-770886aafb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:28.286346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd32dc-797a-48d0-8bbb-770886aafb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.286761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd32dc-797a-48d0-8bbb-770886aafb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.287234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd32dc-797a-48d0-8bbb-770886aafb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.288100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd32dc-797a-48d0-8bbb-770886aafb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:28.290000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd32dc-797a-48d0-8bbb-770886aafb87 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:28.303226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 790/1583] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:28.308361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:28.320630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63108836-abe8-4862-870d-21b8eab5b5b0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:28.326285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:28.327043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.327329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.327747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] PATH_INFO: `/v3/projects/d1f37163f59a489e9247811465c7c40f/users/ff581a2f0d8349a59450ded8abfc5971/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.329839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f37163f59a489e9247811465c7c40f, user_id=ff581a2f0d8349a59450ded8abfc5971, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:28.332645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:28.347887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 794/1584] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:28 2022] PUT /identity/v3/projects/d1f37163f59a489e9247811465c7c40f/users/ff581a2f0d8349a59450ded8abfc5971/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:28.355440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bccd1-00e3-4445-abe4-aef805728ff8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.355812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bccd1-00e3-4445-abe4-aef805728ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.356196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bccd1-00e3-4445-abe4-aef805728ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.388156 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-eb6bccd1-00e3-4445-abe4-aef805728ff8 None None] MFA Rules not processed for user `ff581a2f0d8349a59450ded8abfc5971`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:28.389383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-eb6bccd1-00e3-4445-abe4-aef805728ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:28.475855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 791/1585] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:28.486709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:28.488562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:28.572006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb99a-bcd0-4c1c-8d25-88fb43bae721 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:28.575698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad03f8-dce0-43bb-8a34-3bc4dd04451a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:28.576374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad03f8-dce0-43bb-8a34-3bc4dd04451a service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.576654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad03f8-dce0-43bb-8a34-3bc4dd04451a service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.576927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad03f8-dce0-43bb-8a34-3bc4dd04451a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.581695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:28.650734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad03f8-dce0-43bb-8a34-3bc4dd04451a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:28.652438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad03f8-dce0-43bb-8a34-3bc4dd04451a service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:28.662766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 795/1586] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:28.831550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce31e99-b3e7-49be-bde7-c892ae25686e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.833920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce31e99-b3e7-49be-bde7-c892ae25686e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.834667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce31e99-b3e7-49be-bde7-c892ae25686e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.838311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 792/1587] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:29:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:29:28.860426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:28.860426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:28.860670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:28.893843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:28.895300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:29.121190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 796/1588] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:29.312881 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce31e99-b3e7-49be-bde7-c892ae25686e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:29.325719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0ce31e99-b3e7-49be-bde7-c892ae25686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:29.354659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce31e99-b3e7-49be-bde7-c892ae25686e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:29.362521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46b05-2d38-4b3a-9dff-42720ee489bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:29.363659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46b05-2d38-4b3a-9dff-42720ee489bd service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:29.364059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46b05-2d38-4b3a-9dff-42720ee489bd service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:29.364491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46b05-2d38-4b3a-9dff-42720ee489bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:29.376642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb46b05-2d38-4b3a-9dff-42720ee489bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:29.379780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb46b05-2d38-4b3a-9dff-42720ee489bd service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:29.393168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 793/1589] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:29.674945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:29.676498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:29.747389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9714cf-1026-4a13-9ec6-8090f73c779c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:29.752376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:29.753035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:29.753337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:29.754180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] PATH_INFO: `/v3/users/89ead5fb644948c5b03f11ac7a1d045d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:29.760153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ead5fb644948c5b03f11ac7a1d045d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:29.763167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:29.822648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:29.833338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ead5fb644948c5b03f11ac7a1d045d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:29.834180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ead5fb644948c5b03f11ac7a1d045d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:29.842762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ead5fb644948c5b03f11ac7a1d045d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:29.843550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ead5fb644948c5b03f11ac7a1d045d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:29.858363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ead5fb644948c5b03f11ac7a1d045d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:29.893638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 797/1590] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:29 2022] DELETE /identity/v3/users/89ead5fb644948c5b03f11ac7a1d045d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:29.898310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:29.898810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:29.899062 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:29.939144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:29.940413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.019760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:30.038708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.040068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.047174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 794/1591] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:30.059512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.059826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb5f1-74c0-4ecd-bd0e-0bec9a7b9006 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:30.062483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.064795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:30.066289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.066695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.066978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] PATH_INFO: `/v3/users/135c90193455446c8e80379cbcf0414d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.068156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135c90193455446c8e80379cbcf0414d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:30.070426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:30.131728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135c90193455446c8e80379cbcf0414d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.132420 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135c90193455446c8e80379cbcf0414d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.139882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135c90193455446c8e80379cbcf0414d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.140527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135c90193455446c8e80379cbcf0414d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.140802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0fa6-6dda-4374-ac18-61701596da50 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:30.144376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:30.144980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.145286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.145718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.147437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.152929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68809240-b40a-45db-837d-0e0fbce06470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135c90193455446c8e80379cbcf0414d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.158906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:30.161012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:30.165449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 798/1592] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:30 2022] DELETE /identity/v3/users/135c90193455446c8e80379cbcf0414d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:30.169970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.170256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.170524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.174321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 795/1593] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:30.190201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:30.191458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.308965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 799/1594] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:30.338017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.340275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.357949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e32dab-608d-4c66-bdbd-955d8ede439b service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:30.457090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:30.463742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.465331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.472614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.478002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.478590 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.487373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8b60-40d5-49a0-abc7-48c24e846c03 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:30.501444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:30.502104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.504104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.504406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] PATH_INFO: `/v3/users/6981bf6bac0a4f37916382c621473981` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.505561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:30.506064 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=6981bf6bac0a4f37916382c621473981)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:30.507525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:30.508035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:30.536222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 796/1595] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:30.563065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:30.623322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6981bf6bac0a4f37916382c621473981'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.624214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6981bf6bac0a4f37916382c621473981'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.636186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6981bf6bac0a4f37916382c621473981'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.637043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6981bf6bac0a4f37916382c621473981'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.639279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.641151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.657223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0593739-b2e9-405e-b35c-1b97154be2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6981bf6bac0a4f37916382c621473981'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.684136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 800/1596] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:30 2022] DELETE /identity/v3/users/6981bf6bac0a4f37916382c621473981 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:30.692561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.695340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.698014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.723937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:30.725162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.736212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e76f9-a329-4313-b8f7-beaf9bf27cc2 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:30.813372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 801/1597] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:30.814127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.815535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.819004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:30.828428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55aa0-65cc-44ce-851f-e5335b26585a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:30.831444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:30.832209 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.832597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.833383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.833938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:30.834567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:30.834843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:30.835112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] PATH_INFO: `/v3/projects/84e04cf22f28464da2211cd12bdfcbe1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:30.835494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.836310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e04cf22f28464da2211cd12bdfcbe1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:30.838280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:30.894568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e04cf22f28464da2211cd12bdfcbe1', 'request_id': 'req-51c73b03-7f93-4da0-9dfb-4452a16efe8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.903187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e04cf22f28464da2211cd12bdfcbe1', 'request_id': 'req-51c73b03-7f93-4da0-9dfb-4452a16efe8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.910439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:30.911414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e04cf22f28464da2211cd12bdfcbe1', 'request_id': 'req-51c73b03-7f93-4da0-9dfb-4452a16efe8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.912575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:30.922195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 797/1598] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:30.923293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.927116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.929551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] The token cache is being invalidate because project 84e04cf22f28464da2211cd12bdfcbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:30.929919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.930630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:30.932648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 802/1599] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:30 2022] DELETE /identity/v3/projects/84e04cf22f28464da2211cd12bdfcbe1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:30.936564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:30.939310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:30.984725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:31.034511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5520e-2512-4e9d-9195-f14535ac22a8 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:31.043192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c73b03-7f93-4da0-9dfb-4452a16efe8e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:31.051442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:31.051842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:31.052238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:31.052458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] PATH_INFO: `/v3/users/5191f0104dd54cd29d521884bd128ce2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:31.053951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5191f0104dd54cd29d521884bd128ce2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:31.056198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:31.095460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:31.096976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:31.097381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:31.097928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:31.100907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:31.115472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:31.117771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5191f0104dd54cd29d521884bd128ce2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.118820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5191f0104dd54cd29d521884bd128ce2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.124902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:31.128964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5191f0104dd54cd29d521884bd128ce2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.130706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5191f0104dd54cd29d521884bd128ce2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.136425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 798/1600] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:31.147663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5191f0104dd54cd29d521884bd128ce2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.148969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:31.152611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:31.181114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f400-ac81-408c-b9dc-6bc6488cb4b8 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:31.192341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 803/1601] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:30 2022] DELETE /identity/v3/users/5191f0104dd54cd29d521884bd128ce2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:31.196247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:31.196967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:31.197358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:31.197691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] PATH_INFO: `/v3/projects/eac56fe408f7442fbff44a5511cb81f0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:31.202004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac56fe408f7442fbff44a5511cb81f0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:31.204039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:31.289011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac56fe408f7442fbff44a5511cb81f0', 'request_id': 'req-d314459f-fac0-4550-bf85-347381fe91c3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.298158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac56fe408f7442fbff44a5511cb81f0', 'request_id': 'req-d314459f-fac0-4550-bf85-347381fe91c3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.300659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:31.313397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac56fe408f7442fbff44a5511cb81f0', 'request_id': 'req-d314459f-fac0-4550-bf85-347381fe91c3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.338487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] The token cache is being invalidate because project eac56fe408f7442fbff44a5511cb81f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:31.338784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.341813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.344874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 799/1602] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:31 2022] DELETE /identity/v3/projects/eac56fe408f7442fbff44a5511cb81f0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:31.349932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:31.352157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:31.538581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424f1d-24b5-4d9d-aa31-a6d4a8aa76a8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:31.598936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:31.616244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:31.616920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:31.617205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:31.617524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] PATH_INFO: `/v3/users/d4e8b41629f1460baa96152a6da7b42c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:31.618977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e8b41629f1460baa96152a6da7b42c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:31.621084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:31.743237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e8b41629f1460baa96152a6da7b42c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.745490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e8b41629f1460baa96152a6da7b42c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.772528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e8b41629f1460baa96152a6da7b42c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.779936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e8b41629f1460baa96152a6da7b42c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.805878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e8b41629f1460baa96152a6da7b42c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:31.863755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:31.863755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:31.875696 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 804/1603] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:31 2022] DELETE /identity/v3/users/d4e8b41629f1460baa96152a6da7b42c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:31.878402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314459f-fac0-4550-bf85-347381fe91c3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:31.895748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:31.897272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.023242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.024440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.025272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.025862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] PATH_INFO: `/v3/projects/69b3b37a3d2d43a58e78cf7275b933c5` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.027270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b3b37a3d2d43a58e78cf7275b933c5)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.029307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.036135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb23c94-2f36-4c3b-8bb6-3304fb71f3d1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.042010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.042215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.042627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.042846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.045229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.140529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b3b37a3d2d43a58e78cf7275b933c5', 'request_id': 'req-d8771841-3b63-4079-a610-2fcd7d242bc7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.150050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b3b37a3d2d43a58e78cf7275b933c5', 'request_id': 'req-d8771841-3b63-4079-a610-2fcd7d242bc7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.159298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b3b37a3d2d43a58e78cf7275b933c5', 'request_id': 'req-d8771841-3b63-4079-a610-2fcd7d242bc7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.175651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] The token cache is being invalidate because project 69b3b37a3d2d43a58e78cf7275b933c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:32.176539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.177254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.178212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d8771841-3b63-4079-a610-2fcd7d242bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.181256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.181474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 800/1604] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:31 2022] DELETE /identity/v3/projects/69b3b37a3d2d43a58e78cf7275b933c5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:32.186895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c289f-b9b7-46b7-b439-23c50440b90c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.187645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c289f-b9b7-46b7-b439-23c50440b90c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.188286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c289f-b9b7-46b7-b439-23c50440b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.231156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 805/1605] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:32.246037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-869c289f-b9b7-46b7-b439-23c50440b90c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:32.249571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-869c289f-b9b7-46b7-b439-23c50440b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.389618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:32.391353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.407602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323d1b7-fa71-4038-9196-cfc693955bca service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.450834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:32.453952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 801/1606] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:32.466390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf665f79-c508-4f6a-9e58-50b54b932a40 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.466804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf665f79-c508-4f6a-9e58-50b54b932a40 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.467223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf665f79-c508-4f6a-9e58-50b54b932a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.492937 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bf665f79-c508-4f6a-9e58-50b54b932a40 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:32.494260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bf665f79-c508-4f6a-9e58-50b54b932a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.503550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.503723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 802/1607] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:32.504137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.504415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.504700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] PATH_INFO: `/v3/projects/901c14c22d9b4846bfcd1335c4e612b9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.505855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] RBAC: Authorizing `identity:delete_project(project_id=901c14c22d9b4846bfcd1335c4e612b9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.508102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.509028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf665f79-c508-4f6a-9e58-50b54b932a40 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:32.518311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf665f79-c508-4f6a-9e58-50b54b932a40 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.523825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.524557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.524939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.525537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.526334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:32.526737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.528737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.530813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:32.551000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 803/1608] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:32.552130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:32.565484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddbfad-bc6f-4d58-a5b8-814fdfc9a5e3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.570020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901c14c22d9b4846bfcd1335c4e612b9', 'request_id': 'req-f1958a5b-bab4-47b9-af17-cfc614f317de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.581285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901c14c22d9b4846bfcd1335c4e612b9', 'request_id': 'req-f1958a5b-bab4-47b9-af17-cfc614f317de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.588851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901c14c22d9b4846bfcd1335c4e612b9', 'request_id': 'req-f1958a5b-bab4-47b9-af17-cfc614f317de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.603758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] The token cache is being invalidate because project 901c14c22d9b4846bfcd1335c4e612b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:32.603758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.603758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.605322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 806/1609] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:32 2022] DELETE /identity/v3/projects/901c14c22d9b4846bfcd1335c4e612b9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:32.609326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:32.613085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.637719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d7cb9-8e2b-47b0-9ce7-231f4209d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.638509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d7cb9-8e2b-47b0-9ce7-231f4209d8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.638856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d7cb9-8e2b-47b0-9ce7-231f4209d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.639194 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d7cb9-8e2b-47b0-9ce7-231f4209d8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.639935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d7cb9-8e2b-47b0-9ce7-231f4209d8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.641891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d7cb9-8e2b-47b0-9ce7-231f4209d8b0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.670072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 804/1610] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/projects => generated 361 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:32.671325 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.671602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.671908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.691775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:32.693070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.695042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1958a5b-bab4-47b9-af17-cfc614f317de admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.764974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:32.784388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 805/1611] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:32.785965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:32.788534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.789188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.789495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.789749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] PATH_INFO: `/v3/projects/29513d0068fb430b864185f797c8c7ae` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.791974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.792796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29513d0068fb430b864185f797c8c7ae)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.795898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.806356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001f439-d951-48fa-9daf-5985c58b04a1 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.811184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1a21e-80ae-436c-a40b-2c9bdcddc676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.811905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1a21e-80ae-436c-a40b-2c9bdcddc676 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.812255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1a21e-80ae-436c-a40b-2c9bdcddc676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.812589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1a21e-80ae-436c-a40b-2c9bdcddc676 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.813268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1a21e-80ae-436c-a40b-2c9bdcddc676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.815158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1a21e-80ae-436c-a40b-2c9bdcddc676 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.840231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 806/1612] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/users => generated 281 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:32.840231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc7ec-f5af-46c7-82c7-aab93a260cff None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.840231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc7ec-f5af-46c7-82c7-aab93a260cff None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.840231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc7ec-f5af-46c7-82c7-aab93a260cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.852771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29513d0068fb430b864185f797c8c7ae', 'request_id': 'req-e803122d-744b-40c3-adea-44250e5cc466'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.860453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29513d0068fb430b864185f797c8c7ae', 'request_id': 'req-e803122d-744b-40c3-adea-44250e5cc466'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.860676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-09dbc7ec-f5af-46c7-82c7-aab93a260cff None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:32.861951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-09dbc7ec-f5af-46c7-82c7-aab93a260cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.866068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29513d0068fb430b864185f797c8c7ae', 'request_id': 'req-e803122d-744b-40c3-adea-44250e5cc466'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.881566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] The token cache is being invalidate because project 29513d0068fb430b864185f797c8c7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:32.881864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.882532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:32.884078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 807/1613] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:32 2022] DELETE /identity/v3/projects/29513d0068fb430b864185f797c8c7ae => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:32.884902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:32.886156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.925270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 807/1614] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:32.928743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c0ca-e12c-4749-a0bf-60539c3fa978 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.928743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c0ca-e12c-4749-a0bf-60539c3fa978 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.928743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c0ca-e12c-4749-a0bf-60539c3fa978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.936110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:32.949279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4e09c0ca-e12c-4749-a0bf-60539c3fa978 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:32.950488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4e09c0ca-e12c-4749-a0bf-60539c3fa978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.954241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803122d-744b-40c3-adea-44250e5cc466 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.958930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 808/1615] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:32.959088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60904164-2255-4ac4-b1bd-2e0d0a04c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.959665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904164-2255-4ac4-b1bd-2e0d0a04c18c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.959999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904164-2255-4ac4-b1bd-2e0d0a04c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.960267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904164-2255-4ac4-b1bd-2e0d0a04c18c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.960910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60904164-2255-4ac4-b1bd-2e0d0a04c18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.962514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60904164-2255-4ac4-b1bd-2e0d0a04c18c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.964681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09c0ca-e12c-4749-a0bf-60539c3fa978 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:32.973808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 808/1616] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:32.975054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148590e-35f8-4889-85f2-61033898572f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.975337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148590e-35f8-4889-85f2-61033898572f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.975602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148590e-35f8-4889-85f2-61033898572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.977554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09c0ca-e12c-4749-a0bf-60539c3fa978 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:32.982296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:32.982908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:32.983189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:32.983463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:32.984154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:32.984464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:32.986254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:32.994707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2148590e-35f8-4889-85f2-61033898572f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:32.995924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2148590e-35f8-4889-85f2-61033898572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:32.998452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 809/1617] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:32.999134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.007150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 809/1618] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:33.008136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148590e-35f8-4889-85f2-61033898572f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.018567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148590e-35f8-4889-85f2-61033898572f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.019996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568ede-9552-42ed-890f-dba21efce4cd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.024627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.024758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.025312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.025415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.025505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.025578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.025745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.025844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.026396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.026506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.028207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.028475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.040214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 810/1619] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:33.040878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.050930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c3978-027c-4081-b9dc-60c922f68a91 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.056109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.056723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.057001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.057324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.057903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:33.058201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.059783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.063931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 810/1620] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:33 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:33.063931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.079935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 811/1621] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:33.079935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.090009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554c05e-4bc1-466a-8e8d-321eb5a306be admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.131673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:33.138238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241d2f-506e-44ab-86fc-e7923aa05f09 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.148805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.150296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.150588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.150867 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] PATH_INFO: `/v3/projects/81d6cb53fe924a33a021e941058f0cde/users/acc97b735db54a418297b441a8f9102f/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.154956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.155564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.155868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.156143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.156960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.158889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.171435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d6cb53fe924a33a021e941058f0cde, user_id=acc97b735db54a418297b441a8f9102f, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.174149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.181754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 812/1622] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:33 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:33.182586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.189974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 811/1623] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:33 2022] PUT /identity/v3/projects/81d6cb53fe924a33a021e941058f0cde/users/acc97b735db54a418297b441a8f9102f/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:33.190903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.200512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bf4a-1d1b-4a05-a380-ecfb6cf66be0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.260908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.261186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008669d9-86b4-4170-b3b1-ecb00817f15a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.261668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.261949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.262285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.262980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.264920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.265742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c63fb6-20e9-4f6a-96da-bea599a4ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.266855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c63fb6-20e9-4f6a-96da-bea599a4ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.267136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c63fb6-20e9-4f6a-96da-bea599a4ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.267605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c63fb6-20e9-4f6a-96da-bea599a4ef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.268419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c63fb6-20e9-4f6a-96da-bea599a4ef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.270275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c63fb6-20e9-4f6a-96da-bea599a4ef5b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.280773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 812/1624] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:33.280773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda010-032f-4075-88df-385eb5080d39 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.280773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda010-032f-4075-88df-385eb5080d39 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.280773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda010-032f-4075-88df-385eb5080d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.296873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 813/1625] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:33 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:33.297869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.315772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-12eda010-032f-4075-88df-385eb5080d39 None None] MFA Rules not processed for user `acc97b735db54a418297b441a8f9102f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:33.317025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-12eda010-032f-4075-88df-385eb5080d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:33.344281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:33.398096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7ee37-6931-4f1d-8abc-a2e2ce808144 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.404096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.405396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.405812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.415851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.416096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 813/1626] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:33.417039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda010-032f-4075-88df-385eb5080d39 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.417556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.419759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.436852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda010-032f-4075-88df-385eb5080d39 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.443867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 814/1627] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:33.444749 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.445852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.446801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.447208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.447601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.448472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.451900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.460339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1017e6e-d4e0-43a2-9ca7-55dd6b76b7fb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.468444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.471658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.472032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.472462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] PATH_INFO: `/v3/projects/ce8d3b8bed70410eb78bc076045fe325/users/2a3506fd037d45c4a1c3c7894e8992f0/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.486201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 814/1628] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:33 2022] POST /identity/v3/users => generated 294 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:33.486201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.486734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:33.495428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8d3b8bed70410eb78bc076045fe325, user_id=2a3506fd037d45c4a1c3c7894e8992f0, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.498854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.517785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 815/1629] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:33 2022] PUT /identity/v3/projects/ce8d3b8bed70410eb78bc076045fe325/users/2a3506fd037d45c4a1c3c7894e8992f0/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:33.518826 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.578453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:33.590270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee03a-4b53-40f1-8d88-cb41b6cb00a0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.640166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701fefc-cddb-441a-94de-e14bc6f69df8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.655619 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8fe1f-cef4-48cd-9903-f0cc185c7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.656381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8fe1f-cef4-48cd-9903-f0cc185c7891 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.656665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8fe1f-cef4-48cd-9903-f0cc185c7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.656937 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8fe1f-cef4-48cd-9903-f0cc185c7891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.657591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8fe1f-cef4-48cd-9903-f0cc185c7891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.659337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8fe1f-cef4-48cd-9903-f0cc185c7891 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.668494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.672858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.673232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.673579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.683588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 816/1630] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:33.685784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f6191-1d3e-4775-a07d-064b62c5c909 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.686223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f6191-1d3e-4775-a07d-064b62c5c909 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.687368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f6191-1d3e-4775-a07d-064b62c5c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.741584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ba5f6191-1d3e-4775-a07d-064b62c5c909 None None] MFA Rules not processed for user `2a3506fd037d45c4a1c3c7894e8992f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:33.742811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ba5f6191-1d3e-4775-a07d-064b62c5c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:33.835437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.844198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.869356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 815/1631] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:33.870384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.879419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 817/1632] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:33.883299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f6191-1d3e-4775-a07d-064b62c5c909 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.886313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb42fc-ecf8-4c59-a46c-0371fa2001ec service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.893771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.894567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.894975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.895473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.896252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.897400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f6191-1d3e-4775-a07d-064b62c5c909 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.898477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.905014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.906856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.907292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.907669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] PATH_INFO: `/v3/users/acc97b735db54a418297b441a8f9102f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.908973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc97b735db54a418297b441a8f9102f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.911164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.914302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 816/1633] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:33.915459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:33.930977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b57f8-8582-481d-be37-aed5541e5d21 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:33.942229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:33.943633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:33.944466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:33.945833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:33.947185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:33.950920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:33.955021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:33.996140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc97b735db54a418297b441a8f9102f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:33.997271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc97b735db54a418297b441a8f9102f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:33.998390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 817/1634] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:33 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:33.999299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.004235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:34.025659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc97b735db54a418297b441a8f9102f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:34.027113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc97b735db54a418297b441a8f9102f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:34.039908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc97b735db54a418297b441a8f9102f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:34.062093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 818/1635] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:33 2022] DELETE /identity/v3/users/acc97b735db54a418297b441a8f9102f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:34.062093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.063999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:34.099388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e459-7450-4d0e-933e-b9d71a94d142 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.158926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:34.170250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97592525-7f3a-4a9c-9659-d9f2e644bfc0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.187663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c26e96-fa66-4eb9-b280-843251c181b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.188483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c26e96-fa66-4eb9-b280-843251c181b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.188767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c26e96-fa66-4eb9-b280-843251c181b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.189036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c26e96-fa66-4eb9-b280-843251c181b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.189680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c26e96-fa66-4eb9-b280-843251c181b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.191595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c26e96-fa66-4eb9-b280-843251c181b0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.211857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.212534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.212813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.213081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] PATH_INFO: `/v3/projects/8ba7baac002649ab951b9d77c4cfc7c9/users/6f0e4c4f015b490cb9bf24ebcf8db4ae/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.229073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 819/1636] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:34 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:34.234190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84b46-5e9a-4a2f-8b7c-48c86005a46e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.234544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84b46-5e9a-4a2f-8b7c-48c86005a46e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.234907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf84b46-5e9a-4a2f-8b7c-48c86005a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.238418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba7baac002649ab951b9d77c4cfc7c9, user_id=6f0e4c4f015b490cb9bf24ebcf8db4ae, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.241788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.257506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0bf84b46-5e9a-4a2f-8b7c-48c86005a46e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:34.258789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0bf84b46-5e9a-4a2f-8b7c-48c86005a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:34.263492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 818/1637] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:33 2022] PUT /identity/v3/projects/8ba7baac002649ab951b9d77c4cfc7c9/users/6f0e4c4f015b490cb9bf24ebcf8db4ae/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:34.267046 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.343736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 820/1638] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:34.343736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604399-5468-4cde-b04a-38008d55d7ed None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.343736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604399-5468-4cde-b04a-38008d55d7ed None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.343736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604399-5468-4cde-b04a-38008d55d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.365264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd6523-f160-4124-8fe7-def927735aaa admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.371322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.371938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.372225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.372499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.373150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.375278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.375701 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cd604399-5468-4cde-b04a-38008d55d7ed None None] MFA Rules not processed for user `6f0e4c4f015b490cb9bf24ebcf8db4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:34.377238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cd604399-5468-4cde-b04a-38008d55d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:34.386082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 819/1639] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:34.387255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.391390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:34.403321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:34.458375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d45af-6d26-40a9-810f-c3ed8fd9db32 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.462467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 821/1640] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:34.462467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604399-5468-4cde-b04a-38008d55d7ed None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.469523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.470173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.470446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.470720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.472781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604399-5468-4cde-b04a-38008d55d7ed None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.478101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.478828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.480138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.480138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] PATH_INFO: `/v3/projects/a0862d16e2e4408c836170a2f6b55c36/users/66812957037743a59c2645675adc9d4f/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.482625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.484204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.495202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 820/1641] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:34.496119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.496355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0862d16e2e4408c836170a2f6b55c36, user_id=66812957037743a59c2645675adc9d4f, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.499447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.506329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d02ab-eeb4-43dc-bfc7-3d25c223f2f0 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.513725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.514339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.515148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.515424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.516085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.517987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.523741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 822/1642] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:34 2022] PUT /identity/v3/projects/a0862d16e2e4408c836170a2f6b55c36/users/66812957037743a59c2645675adc9d4f/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:34.528473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.553617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 821/1643] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:34 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:34.557465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.602089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:34.614839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22746d38-7bbb-4638-9d34-f27f23e2c05c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.654214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c45b-8971-4567-bdfe-00ec675d2202 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.666990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.668858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.669147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.669432 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.671070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.677393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.709011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.709741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.710091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.720335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.722028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.725771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 822/1644] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:34 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:34.726287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.726846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.738107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809b519-c873-4772-8e87-6a99d344e3fd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.743615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.744301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.744585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.744859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.745517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.748384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.751679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 823/1645] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:34.760449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.777739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b247-46e7-4267-8e93-59ca6f305e33 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.782004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 823/1646] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:34.784199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:34.786540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda45a-aecb-413d-bea4-a3593d283355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.787535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda45a-aecb-413d-bea4-a3593d283355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.788079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda45a-aecb-413d-bea4-a3593d283355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.788556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda45a-aecb-413d-bea4-a3593d283355 admin admin] PATH_INFO: `/v3/projects/a0862d16e2e4408c836170a2f6b55c36/users/66812957037743a59c2645675adc9d4f/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.790873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda45a-aecb-413d-bea4-a3593d283355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0862d16e2e4408c836170a2f6b55c36, user_id=66812957037743a59c2645675adc9d4f, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:34.796295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda45a-aecb-413d-bea4-a3593d283355 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:34.808139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c213cb-dfbd-4d05-8e16-ea575b72e38c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:34.811069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 824/1647] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:34 2022] PUT /identity/v3/projects/a0862d16e2e4408c836170a2f6b55c36/users/66812957037743a59c2645675adc9d4f/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:34.822908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7fff-110b-4a47-85d1-92247d43b235 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.823268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7fff-110b-4a47-85d1-92247d43b235 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.823675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7fff-110b-4a47-85d1-92247d43b235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.895928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4f5b7fff-110b-4a47-85d1-92247d43b235 None None] MFA Rules not processed for user `66812957037743a59c2645675adc9d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:34.897035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4f5b7fff-110b-4a47-85d1-92247d43b235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:34.928909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:34.942265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:34.943576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:34.946036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:34.946529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] PATH_INFO: `/v3/projects/257019a946c44ec68589850b9a346480/users/87742e3db6bb45efaaaaeca9d68aef57/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:34.996157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257019a946c44ec68589850b9a346480, user_id=87742e3db6bb45efaaaaeca9d68aef57, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:35.000968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:35.031343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 825/1648] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:35.036729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 824/1649] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:34 2022] PUT /identity/v3/projects/257019a946c44ec68589850b9a346480/users/87742e3db6bb45efaaaaeca9d68aef57/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:35.048578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b7fff-110b-4a47-85d1-92247d43b235 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:35.049246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:35.052159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:35.083152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b7fff-110b-4a47-85d1-92247d43b235 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:35.165209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591eb8-3aaf-40ac-b24d-0b5578faac31 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:35.174382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:35.175631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.176305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.177747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.209398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:35.211887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.212175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.212446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.215347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:35.220256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:35.241269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:35.260727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 826/1650] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:35.261363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:35.263176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:35.264247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:35.266444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:35.277600 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc3b8-36ee-42c2-8954-65ee1b5395bf admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:35.284770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:35.285744 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.286258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.286753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] PATH_INFO: `/v3/projects/81d6cb53fe924a33a021e941058f0cde` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.288779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d6cb53fe924a33a021e941058f0cde)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:35.291871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:35.295770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 825/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:35.297035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:35.326651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13a58-7b81-4697-8795-abe3592ff0ed service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:35.331646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651d465-4ed8-416c-8b55-dd3b4af85536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:35.336262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651d465-4ed8-416c-8b55-dd3b4af85536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.336262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651d465-4ed8-416c-8b55-dd3b4af85536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.338789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651d465-4ed8-416c-8b55-dd3b4af85536 admin admin] PATH_INFO: `/v3/projects/257019a946c44ec68589850b9a346480/users/87742e3db6bb45efaaaaeca9d68aef57/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.347477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651d465-4ed8-416c-8b55-dd3b4af85536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257019a946c44ec68589850b9a346480, user_id=87742e3db6bb45efaaaaeca9d68aef57, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:35.354440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651d465-4ed8-416c-8b55-dd3b4af85536 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:35.380598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 826/1652] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:35 2022] PUT /identity/v3/projects/257019a946c44ec68589850b9a346480/users/87742e3db6bb45efaaaaeca9d68aef57/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:35.390786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.391081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.391356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.466527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d6cb53fe924a33a021e941058f0cde', 'request_id': 'req-874e19dd-abf1-4408-b300-f37d3b54dc9c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:35.481086 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d6cb53fe924a33a021e941058f0cde', 'request_id': 'req-874e19dd-abf1-4408-b300-f37d3b54dc9c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:35.500623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d6cb53fe924a33a021e941058f0cde', 'request_id': 'req-874e19dd-abf1-4408-b300-f37d3b54dc9c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:35.503977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] MFA Rules not processed for user `87742e3db6bb45efaaaaeca9d68aef57`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:35.505392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:35.548258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] The token cache is being invalidate because project 81d6cb53fe924a33a021e941058f0cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:35.548540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:35.549670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-874e19dd-abf1-4408-b300-f37d3b54dc9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:35.552804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 827/1653] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:35 2022] DELETE /identity/v3/projects/81d6cb53fe924a33a021e941058f0cde => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:35.559602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe45940-4567-448a-84d3-3fd6caebc042 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.561417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe45940-4567-448a-84d3-3fd6caebc042 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.561705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe45940-4567-448a-84d3-3fd6caebc042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.661930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bfe45940-4567-448a-84d3-3fd6caebc042 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:35.666392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bfe45940-4567-448a-84d3-3fd6caebc042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:35.695688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 827/1654] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:35.748396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:35.753769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:35.755696 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:35.807066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 828/1655] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:35.809085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6b44-6fad-4b38-b1d6-c79b3918d7a9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.809498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6b44-6fad-4b38-b1d6-c79b3918d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.809628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6b44-6fad-4b38-b1d6-c79b3918d7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.850503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9a5d6b44-6fad-4b38-b1d6-c79b3918d7a9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:35.851011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d16d1f-3174-4f93-ba58-1361589aef71 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:35.853660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9a5d6b44-6fad-4b38-b1d6-c79b3918d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:35.860906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:35.860906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.860906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.860906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.875278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 829/1656] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:35.876885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6b44-6fad-4b38-b1d6-c79b3918d7a9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:35.885100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:35.887046 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:35.887163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6b44-6fad-4b38-b1d6-c79b3918d7a9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:35.903762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:35.905901 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:35.906281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:35.906647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:35.907407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:35.907824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:35.911074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:35.912356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 828/1657] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:35.945904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 830/1658] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:35.946821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:35.979089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466fb3-c825-4a21-92d3-c9ebaf65cdb7 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:35.999934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:36.000648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.000931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.001206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.001887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:36.004296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:36.110795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 829/1659] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:35 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:36.116645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:36.131233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dad54a-834a-4020-a35c-e33410f25194 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:36.252361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:36.252502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:36.254546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:36.255964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.256474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.256762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.257429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:36.260331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:36.276241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9f0a-212c-4e99-8142-65a43c8454e5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:36.294346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:36.295559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.295871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.296149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] PATH_INFO: `/v3/users/6f0e4c4f015b490cb9bf24ebcf8db4ae` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.298998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0e4c4f015b490cb9bf24ebcf8db4ae)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:36.303088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:36.304667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 831/1660] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:36 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:36.307495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:36.329290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf382-cc1c-4159-8bc3-4bc590d5effa admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:36.358562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:36.368777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:36.370202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.370499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.370775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.371640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:36.374479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:36.389511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 832/1661] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:36.391368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0e4c4f015b490cb9bf24ebcf8db4ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.393730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0e4c4f015b490cb9bf24ebcf8db4ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.395868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:36.399273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:36.414395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0e4c4f015b490cb9bf24ebcf8db4ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.415343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0e4c4f015b490cb9bf24ebcf8db4ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.434716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb240-4dad-4236-8761-8441e8319f8d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:36.444405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:36.445070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.445361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.445638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.446295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:36.453959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:36.460713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0e4c4f015b490cb9bf24ebcf8db4ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.480875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 833/1662] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:36.482123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:36.488706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 830/1663] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:36 2022] DELETE /identity/v3/users/6f0e4c4f015b490cb9bf24ebcf8db4ae => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:36.488706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:36.490514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:36.509994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa9cd-ddcc-47c5-a379-01cab31747f9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:36.600893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b49d-9238-4083-b717-8a882ce14d3e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:36.624063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f753d2-4037-41d0-87f4-c56b08ee2318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:36.625178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f753d2-4037-41d0-87f4-c56b08ee2318 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.625551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f753d2-4037-41d0-87f4-c56b08ee2318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.626036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f753d2-4037-41d0-87f4-c56b08ee2318 admin admin] PATH_INFO: `/v3/projects/a32c8beca89e4396a6ad67c5deaea32b/users/c0dd49c1b3b242558a40b6e798e952f7/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.633714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:36.634452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.634811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.635162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] PATH_INFO: `/v3/users/2a3506fd037d45c4a1c3c7894e8992f0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.637710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3506fd037d45c4a1c3c7894e8992f0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:36.642638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:36.646941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f753d2-4037-41d0-87f4-c56b08ee2318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32c8beca89e4396a6ad67c5deaea32b, user_id=c0dd49c1b3b242558a40b6e798e952f7, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:36.649781 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f753d2-4037-41d0-87f4-c56b08ee2318 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:36.669486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 831/1664] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:36 2022] PUT /identity/v3/projects/a32c8beca89e4396a6ad67c5deaea32b/users/c0dd49c1b3b242558a40b6e798e952f7/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:36.671194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52645676-8bf6-4b42-971e-ebe045f4d03a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.671407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52645676-8bf6-4b42-971e-ebe045f4d03a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.671685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52645676-8bf6-4b42-971e-ebe045f4d03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.695006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-52645676-8bf6-4b42-971e-ebe045f4d03a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:36.696737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-52645676-8bf6-4b42-971e-ebe045f4d03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:36.714204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:36.766755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3506fd037d45c4a1c3c7894e8992f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.767498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3506fd037d45c4a1c3c7894e8992f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.807584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3506fd037d45c4a1c3c7894e8992f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.808579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3506fd037d45c4a1c3c7894e8992f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.813040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 832/1665] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:36.817993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.818291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.818825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.827746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-25c3e1d2-d5b7-4402-b2d5-8cd3563ffbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3506fd037d45c4a1c3c7894e8992f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:36.841307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:36.842527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:36.851273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 833/1666] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:36.852219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:36.853589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:36.854852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 834/1667] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:36 2022] DELETE /identity/v3/users/2a3506fd037d45c4a1c3c7894e8992f0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:36.859639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6c91-49d7-4eb6-a276-2d24ec30233f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:36.859973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6c91-49d7-4eb6-a276-2d24ec30233f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:36.860257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6c91-49d7-4eb6-a276-2d24ec30233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:36.893400 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d54b6c91-49d7-4eb6-a276-2d24ec30233f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:36.895159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d54b6c91-49d7-4eb6-a276-2d24ec30233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:36.905808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:36.998036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 835/1668] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:36.998860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b6c91-49d7-4eb6-a276-2d24ec30233f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:37.005252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b030-490a-413a-9650-b25e704c1267 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:37.099317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b6c91-49d7-4eb6-a276-2d24ec30233f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:37.112709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:37.113951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:37.114383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:37.114903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:37.115259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:37.116009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:37.116323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:37.117363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:37.127148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:37.129175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:37.131422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:37.133238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:37.141884 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 834/1669] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:37.143035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:37.144444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 836/1670] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:37.151864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cefa2b-80dd-4cc5-b31b-528841f50f9c service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:37.155717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed463ccc-c896-4c5d-9edd-17ed8031fe86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:37.156367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed463ccc-c896-4c5d-9edd-17ed8031fe86 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:37.156649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed463ccc-c896-4c5d-9edd-17ed8031fe86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:37.156924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed463ccc-c896-4c5d-9edd-17ed8031fe86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:37.167085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed463ccc-c896-4c5d-9edd-17ed8031fe86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:37.168619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed463ccc-c896-4c5d-9edd-17ed8031fe86 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:37.179608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 835/1671] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:37.461578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:37.464611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:37.486415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd156992-2cf3-421c-b14d-68e7fc588133 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:37.495290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:37.497126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:37.498172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:37.498331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] PATH_INFO: `/v3/users/fcae7f830d03417b8dfedafc21928f9e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:37.500611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcae7f830d03417b8dfedafc21928f9e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:37.503613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:37.566876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:37.575200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcae7f830d03417b8dfedafc21928f9e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:37.576050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcae7f830d03417b8dfedafc21928f9e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:37.596345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcae7f830d03417b8dfedafc21928f9e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:37.597426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcae7f830d03417b8dfedafc21928f9e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:37.606829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcae7f830d03417b8dfedafc21928f9e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:37.625138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 837/1672] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:37 2022] DELETE /identity/v3/users/fcae7f830d03417b8dfedafc21928f9e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:37.627206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:37.627495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:37.627830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:37.676218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:37.680175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:37.767032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 836/1673] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:37.780517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:37.782016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:37.913809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83dfb9-1e44-4ccb-96f8-a7e9cb0aef6d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:37.923930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:37.924598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:37.924878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:37.925154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:37.939965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:37.941698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:37.958306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 838/1674] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:38.283707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:38.285095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:38.304069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50804c-be5b-49a8-8198-39acffb45272 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:38.309967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:38.311647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:38.325170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:38.325972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:38.326249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:38.327644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] PATH_INFO: `/v3/projects/ce8d3b8bed70410eb78bc076045fe325` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:38.330497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8d3b8bed70410eb78bc076045fe325)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:38.332478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:38.337285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda8a0-4996-499e-b205-b52a2af0544d service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:38.353278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:38.353944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:38.354223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:38.354505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] PATH_INFO: `/v3/projects/8ba7baac002649ab951b9d77c4cfc7c9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:38.355935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba7baac002649ab951b9d77c4cfc7c9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:38.358518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:38.458050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8d3b8bed70410eb78bc076045fe325', 'request_id': 'req-8d6144da-3bdd-4687-8d82-8ec80f92e683'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.468810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba7baac002649ab951b9d77c4cfc7c9', 'request_id': 'req-de930539-eb0d-4094-8caf-b4b3e9078bb4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.475334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8d3b8bed70410eb78bc076045fe325', 'request_id': 'req-8d6144da-3bdd-4687-8d82-8ec80f92e683'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.486412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba7baac002649ab951b9d77c4cfc7c9', 'request_id': 'req-de930539-eb0d-4094-8caf-b4b3e9078bb4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.487076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8d3b8bed70410eb78bc076045fe325', 'request_id': 'req-8d6144da-3bdd-4687-8d82-8ec80f92e683'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.490360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:38.505871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba7baac002649ab951b9d77c4cfc7c9', 'request_id': 'req-de930539-eb0d-4094-8caf-b4b3e9078bb4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.519054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] The token cache is being invalidate because project ce8d3b8bed70410eb78bc076045fe325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:38.520797 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.523142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.530186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 837/1675] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:38 2022] DELETE /identity/v3/projects/ce8d3b8bed70410eb78bc076045fe325 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:38.530367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] The token cache is being invalidate because project 8ba7baac002649ab951b9d77c4cfc7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:38.530367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.530367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.533002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:38.534843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:38.536426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 839/1676] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:38 2022] DELETE /identity/v3/projects/8ba7baac002649ab951b9d77c4cfc7c9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:38.540855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:38.545238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:38.740832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:38.781885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6144da-3bdd-4687-8d82-8ec80f92e683 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:38.789128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930539-eb0d-4094-8caf-b4b3e9078bb4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:38.790152 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:38.791131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:38.791493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:38.793102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] PATH_INFO: `/v3/users/66812957037743a59c2645675adc9d4f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:38.795348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=66812957037743a59c2645675adc9d4f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:38.797333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:38.797757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:38.798406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:38.798686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:38.798958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] PATH_INFO: `/v3/users/87742e3db6bb45efaaaaeca9d68aef57` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:38.800131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=87742e3db6bb45efaaaaeca9d68aef57)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:38.802061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:38.872056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87742e3db6bb45efaaaaeca9d68aef57'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.873806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87742e3db6bb45efaaaaeca9d68aef57'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.876929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66812957037743a59c2645675adc9d4f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.877799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66812957037743a59c2645675adc9d4f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.894312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87742e3db6bb45efaaaaeca9d68aef57'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.895174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87742e3db6bb45efaaaaeca9d68aef57'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.907702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87742e3db6bb45efaaaaeca9d68aef57'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.918040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66812957037743a59c2645675adc9d4f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.918833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66812957037743a59c2645675adc9d4f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.936208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 840/1677] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:38 2022] DELETE /identity/v3/users/87742e3db6bb45efaaaaeca9d68aef57 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:38.940739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-62afd8bc-df25-4983-9cb6-64caf5f398ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66812957037743a59c2645675adc9d4f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:38.955641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 838/1678] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:38 2022] DELETE /identity/v3/users/66812957037743a59c2645675adc9d4f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:39.131503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:39.133262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.258371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9a03-9a86-4134-802b-6b1a06944ceb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:39.263616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20cff0-6715-4409-a241-51d153364fca None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:39.264186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20cff0-6715-4409-a241-51d153364fca None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:39.264643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20cff0-6715-4409-a241-51d153364fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:39.324756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fa20cff0-6715-4409-a241-51d153364fca None None] MFA Rules not processed for user `c0dd49c1b3b242558a40b6e798e952f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:39.325987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fa20cff0-6715-4409-a241-51d153364fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.364974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:39.366154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:39.366455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:39.366739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] PATH_INFO: `/v3/projects/d4e0f0fc38514c09a0deda2191fd47a0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:39.367944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e0f0fc38514c09a0deda2191fd47a0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:39.369912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:39.384626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:39.446723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 839/1679] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:39.456980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e0f0fc38514c09a0deda2191fd47a0', 'request_id': 'req-1ce16e02-2a14-46c1-9052-4425d1226b27'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.459020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20cff0-6715-4409-a241-51d153364fca None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:39.460543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fa20cff0-6715-4409-a241-51d153364fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.467935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:39.478946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e0f0fc38514c09a0deda2191fd47a0', 'request_id': 'req-1ce16e02-2a14-46c1-9052-4425d1226b27'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.490728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e0f0fc38514c09a0deda2191fd47a0', 'request_id': 'req-1ce16e02-2a14-46c1-9052-4425d1226b27'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.517700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] The token cache is being invalidate because project d4e0f0fc38514c09a0deda2191fd47a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:39.518125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.518949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.524087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 841/1680] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:39 2022] DELETE /identity/v3/projects/d4e0f0fc38514c09a0deda2191fd47a0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:39.524087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:39.524087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.570102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20cff0-6715-4409-a241-51d153364fca None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:39.624618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce16e02-2a14-46c1-9052-4425d1226b27 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:39.629708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:39.630726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:39.631017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:39.631582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] PATH_INFO: `/v3/projects/257019a946c44ec68589850b9a346480` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:39.636082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257019a946c44ec68589850b9a346480)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:39.636082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:39.662920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:39.663611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:39.664002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:39.664356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:39.666174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.696574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257019a946c44ec68589850b9a346480', 'request_id': 'req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.703720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257019a946c44ec68589850b9a346480', 'request_id': 'req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.712213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257019a946c44ec68589850b9a346480', 'request_id': 'req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.731145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] The token cache is being invalidate because project 257019a946c44ec68589850b9a346480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:39.731446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.732129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.734188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 842/1681] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:39 2022] DELETE /identity/v3/projects/257019a946c44ec68589850b9a346480 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:39.738440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:39.740413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.741350 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:39.742875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:39.752553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 840/1682] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:39.753308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:39.754616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.778457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:39.788446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6701c-872c-4881-a5f1-e764949dc620 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:39.826599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbe1c5-4fc0-4904-9f89-2a30ad03a2a6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:39.834469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:39.836096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:39.838276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:39.838557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] PATH_INFO: `/v3/users/a089fa1588ae48cdbf7b7469b4fac235` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:39.840824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a089fa1588ae48cdbf7b7469b4fac235)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:39.844840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:39.863461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:39.864145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:39.864558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:39.864836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] PATH_INFO: `/v3/projects/a0862d16e2e4408c836170a2f6b55c36` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:39.865978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0862d16e2e4408c836170a2f6b55c36)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:39.868069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:39.886341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:39.917941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a089fa1588ae48cdbf7b7469b4fac235'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.918712 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a089fa1588ae48cdbf7b7469b4fac235'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.925877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0862d16e2e4408c836170a2f6b55c36', 'request_id': 'req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.934528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0862d16e2e4408c836170a2f6b55c36', 'request_id': 'req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.939954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a089fa1588ae48cdbf7b7469b4fac235'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.940898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a089fa1588ae48cdbf7b7469b4fac235'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.942298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0862d16e2e4408c836170a2f6b55c36', 'request_id': 'req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.951257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4cf7d374-50bc-45c1-9266-8be7a1f5abd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a089fa1588ae48cdbf7b7469b4fac235'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.962257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] The token cache is being invalidate because project a0862d16e2e4408c836170a2f6b55c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:39.964096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.965296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:39.967402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 841/1683] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:39 2022] DELETE /identity/v3/projects/a0862d16e2e4408c836170a2f6b55c36 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:39.968822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:39.969628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 843/1684] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:39 2022] DELETE /identity/v3/users/a089fa1588ae48cdbf7b7469b4fac235 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:39.971442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:39.973252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14e55-ae77-44ef-816c-395981c59509 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:39.973616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14e55-ae77-44ef-816c-395981c59509 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:39.974032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14e55-ae77-44ef-816c-395981c59509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.001100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7fd14e55-ae77-44ef-816c-395981c59509 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:40.002589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7fd14e55-ae77-44ef-816c-395981c59509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.119276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 844/1685] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:40.119276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3b0b8-79c8-4af9-81a1-a9da757ce00b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.119276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3b0b8-79c8-4af9-81a1-a9da757ce00b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.119276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3b0b8-79c8-4af9-81a1-a9da757ce00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.120305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f777-fc9e-435b-a1d5-0b19bd6da44f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.131755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.133386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.133769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.134120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] PATH_INFO: `/v3/users/b5eeadf0e79f41c79a5538192a82b071` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.135478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5eeadf0e79f41c79a5538192a82b071)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.137744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.147250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d0e3b0b8-79c8-4af9-81a1-a9da757ce00b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:40.148743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d0e3b0b8-79c8-4af9-81a1-a9da757ce00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.160778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 845/1686] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:40.162674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552345b-8b5a-4c21-8e49-8723df1c3544 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.163135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552345b-8b5a-4c21-8e49-8723df1c3544 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.163327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552345b-8b5a-4c21-8e49-8723df1c3544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.197099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6552345b-8b5a-4c21-8e49-8723df1c3544 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:40.198897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6552345b-8b5a-4c21-8e49-8723df1c3544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.220009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 846/1687] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:40.220009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.220009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.220009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.220380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5eeadf0e79f41c79a5538192a82b071'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.220380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5eeadf0e79f41c79a5538192a82b071'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.246069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5eeadf0e79f41c79a5538192a82b071'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.247079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5eeadf0e79f41c79a5538192a82b071'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.250918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:40.252279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.268549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5eeadf0e79f41c79a5538192a82b071'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.275114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 847/1688] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:40.276621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.278003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.290460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 842/1689] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:39 2022] DELETE /identity/v3/users/b5eeadf0e79f41c79a5538192a82b071 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:40.290460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.308543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6fb5-c982-4cab-add1-891e5d54df80 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.329111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:40.378078 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:40.387967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082440f2-0257-4640-a0a5-9445edb272da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.387967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf87a07-39c6-4d75-97d1-047336ad090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.387967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87a07-39c6-4d75-97d1-047336ad090c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.387967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87a07-39c6-4d75-97d1-047336ad090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.388404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87a07-39c6-4d75-97d1-047336ad090c admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.388404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf87a07-39c6-4d75-97d1-047336ad090c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:40.388404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf87a07-39c6-4d75-97d1-047336ad090c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.392987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf87a07-39c6-4d75-97d1-047336ad090c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.410812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 843/1690] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:40.410812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e2c9-3a04-434f-814f-e641bcddf3bc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.410812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e2c9-3a04-434f-814f-e641bcddf3bc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.410812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e2c9-3a04-434f-814f-e641bcddf3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.437237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3400e2c9-3a04-434f-814f-e641bcddf3bc None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:40.437984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.438605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.438718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3400e2c9-3a04-434f-814f-e641bcddf3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.438884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.439140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.439843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:40.440147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.441978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.451196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 844/1691] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:40.452747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e2c9-3a04-434f-814f-e641bcddf3bc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.459118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 848/1692] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:40.460236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.464089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e2c9-3a04-434f-814f-e641bcddf3bc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.469219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.469829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.470117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.470220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7289-4270-4a72-911c-8929532b08d3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.470470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.471003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.472936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.475267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.475911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.476246 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.476576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.477297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.479893 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.510383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 845/1693] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:40.510383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.510646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.516803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 849/1694] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/projects => generated 407 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:40.517790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.521847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.573467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18b20e-f4d3-4e1c-a3cc-42297b86edef admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.589541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99056d2-466e-444f-a08d-99c096fac739 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.594341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.594979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.595267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.595543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] PATH_INFO: `/v3/projects/bc67b7bdf3a44322a8a5fbbcd5d0fea8` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.596815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc67b7bdf3a44322a8a5fbbcd5d0fea8)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.598729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.626174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.626436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.626699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.627060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.637603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.639163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.650906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 846/1695] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:40.658476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc67b7bdf3a44322a8a5fbbcd5d0fea8', 'request_id': 'req-9d2aba6c-499b-4f58-9642-f1a786af87a0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.659221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.665347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc67b7bdf3a44322a8a5fbbcd5d0fea8', 'request_id': 'req-9d2aba6c-499b-4f58-9642-f1a786af87a0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.675471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159db803-018e-4003-bebc-afb73ccc2332 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.677662 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc67b7bdf3a44322a8a5fbbcd5d0fea8', 'request_id': 'req-9d2aba6c-499b-4f58-9642-f1a786af87a0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.689455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] The token cache is being invalidate because project bc67b7bdf3a44322a8a5fbbcd5d0fea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:40.689941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.690521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.692349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 850/1696] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:40 2022] DELETE /identity/v3/projects/bc67b7bdf3a44322a8a5fbbcd5d0fea8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:40.692942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.696512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.728941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:40.740767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:40.747082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.747729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.748080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.748486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.749597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.751591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.778473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 847/1697] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:40.779924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.780555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aba6c-499b-4f58-9642-f1a786af87a0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.783243 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.788163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.788956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.789276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.789557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.790200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.792750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.796625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48dac-fbde-4fa8-ac4b-5b9c10d800a5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.801407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.802194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.802391 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.802674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] PATH_INFO: `/v3/users/ff581a2f0d8349a59450ded8abfc5971` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.804037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff581a2f0d8349a59450ded8abfc5971)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.805855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.818278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 851/1698] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:40 2022] POST /identity/v3/users => generated 304 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:40.819288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.821030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.834449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688332-7f74-41de-9489-3ff2f0362605 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.843722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.844466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.844831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.845181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.845928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.847746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.862926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 852/1699] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:40.864006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.873446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff581a2f0d8349a59450ded8abfc5971'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.874858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff581a2f0d8349a59450ded8abfc5971'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.876640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066f651-1643-4fb3-8eeb-03e294a52e61 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:40.882316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:40.882915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:40.883172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:40.883444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:40.884144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:40.885546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff581a2f0d8349a59450ded8abfc5971'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.885938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:40.886580 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff581a2f0d8349a59450ded8abfc5971'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.897020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 853/1700] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:40.897922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.903951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.904108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff581a2f0d8349a59450ded8abfc5971'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:40.919039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 848/1701] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:40 2022] DELETE /identity/v3/users/ff581a2f0d8349a59450ded8abfc5971 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:40.920120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:40.921617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:40.927553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae1e1-33b7-46fc-8dd3-3fe3776c64bd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.023562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.024249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.024811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.025539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.026204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.027843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.028112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77585f-90c0-40a5-9e87-1f855f956dda admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.033065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.033770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.034178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.034576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.035308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.037220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.040596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 854/1702] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:41.041717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.044587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.048024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 849/1703] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:41.048951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.062504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0a0a-3c27-480b-8268-36727d199a31 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.063556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52e90-8544-41a8-8148-107d96aa3745 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.068132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.068956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.069283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.069628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.069732 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] PATH_INFO: `/v3/projects/28db168621bb4479a98cfaed9fc50288/users/c6ea4166aab04526b778a181b1f1bf67/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.070270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.070560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.070835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] PATH_INFO: `/v3/projects/2bbd25c208ca495baaad39749f344166` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.072842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbd25c208ca495baaad39749f344166)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.075733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.088357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28db168621bb4479a98cfaed9fc50288, user_id=c6ea4166aab04526b778a181b1f1bf67, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.091649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.108081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 850/1704] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:41 2022] PUT /identity/v3/projects/28db168621bb4479a98cfaed9fc50288/users/c6ea4166aab04526b778a181b1f1bf67/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:41.112916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.149354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:41.153355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbd25c208ca495baaad39749f344166', 'request_id': 'req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.164797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbd25c208ca495baaad39749f344166', 'request_id': 'req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.173289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbd25c208ca495baaad39749f344166', 'request_id': 'req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.186221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] The token cache is being invalidate because project 2bbd25c208ca495baaad39749f344166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:41.186815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.187533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5cfa0ed1-fd0c-4f2c-a8b6-c3fce425ad7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.192539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 855/1705] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:41 2022] DELETE /identity/v3/projects/2bbd25c208ca495baaad39749f344166 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:41.192539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.192539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.192539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.196396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16382b-5eb0-42a5-9098-76e66a98601a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.227391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] MFA Rules not processed for user `c6ea4166aab04526b778a181b1f1bf67`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:41.228707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.238632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:41.271996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02045e1e-df56-4a1d-bf4e-a2e55f270403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.272672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02045e1e-df56-4a1d-bf4e-a2e55f270403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.272957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02045e1e-df56-4a1d-bf4e-a2e55f270403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.273235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02045e1e-df56-4a1d-bf4e-a2e55f270403 admin admin] PATH_INFO: `/v3/projects/5f534253584949f791139f85ec5b2cf2/users/1eb2b1cb33644ea8a6f56ef24b46610e/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.299076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02045e1e-df56-4a1d-bf4e-a2e55f270403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f534253584949f791139f85ec5b2cf2, user_id=1eb2b1cb33644ea8a6f56ef24b46610e, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.302482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02045e1e-df56-4a1d-bf4e-a2e55f270403 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.316397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 851/1706] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:41 2022] PUT /identity/v3/projects/5f534253584949f791139f85ec5b2cf2/users/1eb2b1cb33644ea8a6f56ef24b46610e/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:41.317626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf38bf2-b721-4b7f-979f-ee8d26e250de None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.317916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf38bf2-b721-4b7f-979f-ee8d26e250de None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.318233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf38bf2-b721-4b7f-979f-ee8d26e250de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.329829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 856/1707] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:41.330753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.332172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.339207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-acf38bf2-b721-4b7f-979f-ee8d26e250de None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:41.340414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-acf38bf2-b721-4b7f-979f-ee8d26e250de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.346255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f027e-47a9-4e3b-820d-5431f6857913 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.405652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 852/1708] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:41.405652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc723b6-36a2-40a6-ab6c-b8d467357c43 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.405652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc723b6-36a2-40a6-ab6c-b8d467357c43 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.405652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc723b6-36a2-40a6-ab6c-b8d467357c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.410757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.411406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.411688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.412125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] PATH_INFO: `/v3/projects/d1f37163f59a489e9247811465c7c40f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.413260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f37163f59a489e9247811465c7c40f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.415310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.424531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4dc723b6-36a2-40a6-ab6c-b8d467357c43 None None] MFA Rules not processed for user `c0dd49c1b3b242558a40b6e798e952f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:41.425748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4dc723b6-36a2-40a6-ab6c-b8d467357c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.469653 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f37163f59a489e9247811465c7c40f', 'request_id': 'req-28422be1-633e-4814-a526-28ec8aa18a86'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.476337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f37163f59a489e9247811465c7c40f', 'request_id': 'req-28422be1-633e-4814-a526-28ec8aa18a86'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.481473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:41.488483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f37163f59a489e9247811465c7c40f', 'request_id': 'req-28422be1-633e-4814-a526-28ec8aa18a86'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.494947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 853/1709] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:41.499123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ce5b-f231-4340-a91e-fc1377e91680 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.499123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ce5b-f231-4340-a91e-fc1377e91680 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.499123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ce5b-f231-4340-a91e-fc1377e91680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.505242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] The token cache is being invalidate because project d1f37163f59a489e9247811465c7c40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:41.505585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.506299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:41.508158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 857/1710] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:41 2022] DELETE /identity/v3/projects/d1f37163f59a489e9247811465c7c40f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:41.509539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.511022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.539506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6294ce5b-f231-4340-a91e-fc1377e91680 None None] MFA Rules not processed for user `1eb2b1cb33644ea8a6f56ef24b46610e`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:41.540930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6294ce5b-f231-4340-a91e-fc1377e91680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.570831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:41.603714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422be1-633e-4814-a526-28ec8aa18a86 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.610221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0200d5-cef4-4f86-819c-13adda75d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.611055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0200d5-cef4-4f86-819c-13adda75d637 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.611338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0200d5-cef4-4f86-819c-13adda75d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.611611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0200d5-cef4-4f86-819c-13adda75d637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.612334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0200d5-cef4-4f86-819c-13adda75d637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.614433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0200d5-cef4-4f86-819c-13adda75d637 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.621003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 854/1711] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:41.622039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.622325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.622595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.645406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:41.647114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.657069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 858/1712] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:41.657069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265183c-052d-4cd6-a8da-7df1ddb2d72f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.657069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265183c-052d-4cd6-a8da-7df1ddb2d72f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.657069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265183c-052d-4cd6-a8da-7df1ddb2d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.681454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a265183c-052d-4cd6-a8da-7df1ddb2d72f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:41.682673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a265183c-052d-4cd6-a8da-7df1ddb2d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.728551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 855/1713] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:41.729775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.732425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.746529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3dc7f-5aa0-4b11-8632-31db36e0e289 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.750874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 859/1714] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:41.751751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265183c-052d-4cd6-a8da-7df1ddb2d72f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.752615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.753307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.753655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.754105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.758761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.758761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.762255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265183c-052d-4cd6-a8da-7df1ddb2d72f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.768039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28111db-c924-498f-ab66-b417180d7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.769148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28111db-c924-498f-ab66-b417180d7220 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.769443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28111db-c924-498f-ab66-b417180d7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.769717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28111db-c924-498f-ab66-b417180d7220 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.770357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28111db-c924-498f-ab66-b417180d7220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.774655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28111db-c924-498f-ab66-b417180d7220 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.791861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 856/1715] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/projects => generated 407 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:41.792944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.801537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 860/1716] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/users => generated 300 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:41.804443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba80886-91aa-4487-81c6-fbaf824bbe8b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.804741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba80886-91aa-4487-81c6-fbaf824bbe8b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.805016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba80886-91aa-4487-81c6-fbaf824bbe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.828010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-aba80886-91aa-4487-81c6-fbaf824bbe8b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:41.829239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-aba80886-91aa-4487-81c6-fbaf824bbe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:41.874425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f793b70-a8e1-4aa5-821e-68e4d095c815 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.884574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.885400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.885740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.886078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.886894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:41.887422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.889210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.902126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:41.904620 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 861/1717] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:41.906271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba80886-91aa-4487-81c6-fbaf824bbe8b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.916110 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 857/1718] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:41.917257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.920514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba80886-91aa-4487-81c6-fbaf824bbe8b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.926289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.926906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.927192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.927467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.928176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.930109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.931621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe57f-c98e-4e64-8974-eff07aed29bf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.938471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.939469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.939838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.940737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.941986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.945000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.956775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 862/1719] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/users => generated 310 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:41.958094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.962835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 858/1720] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:41.964929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:41.970460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0c08-287a-4d00-b427-9ba542bb9c72 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.976795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad5ac-a36b-4b03-8857-8a7053004f96 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:41.978403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.979287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.979571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.979905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.980567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:41.980877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.982689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:41.983671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:41.984728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:41.985042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:41.985289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:41.985986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:41.988096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.004205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 863/1721] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:42.005060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.016316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8564ff-c71d-4296-97e5-0386e3a900b4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.022810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.024162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.024548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.025238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.026233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.027989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.032187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 859/1722] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:41 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:42.032187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.043912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 864/1723] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:42.044951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.052145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:42.057834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64074534-4150-4e8d-bb7d-53a0c385ae77 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.115570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c97ee8-4787-4f00-a2a3-4d1a0a5d61f4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.121473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.122231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.123049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.123325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] PATH_INFO: `/v3/projects/4fd280cd0ae7497a99b5f724438df923/users/3c5d0e10b13d4abc89e5b16eb7083297/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.138047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.138922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.139119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.139649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.140359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.142024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd280cd0ae7497a99b5f724438df923, user_id=3c5d0e10b13d4abc89e5b16eb7083297, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.142911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.145369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.163779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 860/1724] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:42 2022] PUT /identity/v3/projects/4fd280cd0ae7497a99b5f724438df923/users/3c5d0e10b13d4abc89e5b16eb7083297/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:42.165141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.176041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 865/1725] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:42 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:42.176939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.248968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa3be1-78ad-4d85-9760-8d4655630d82 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.254899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da54e5-e145-4446-94fc-6edccf29dfff admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.255475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.256184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.256519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.257158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] PATH_INFO: `/v3/projects/ac8a75ceba6c4cb6b882f44112bcca18/users/04ce3b8ceb29435a90738a4107cee8c1/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.260720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.261452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.261790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.262142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.262849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.270338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.275203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8a75ceba6c4cb6b882f44112bcca18, user_id=04ce3b8ceb29435a90738a4107cee8c1, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.277897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.299080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 861/1727] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:42 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:42.299080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.300867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 866/1727] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:42 2022] PUT /identity/v3/projects/ac8a75ceba6c4cb6b882f44112bcca18/users/04ce3b8ceb29435a90738a4107cee8c1/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:42.301961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.311951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1900d-8a2e-4adc-aca7-343a0f4eb2eb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.359641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:42.398364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.399510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.399848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.400111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.400755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.402178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d326a-368c-448a-bcf1-92038c906554 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.402408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.408574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.409349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.409444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.409732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.410442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.412295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.423480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 862/1728] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:42.425278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.437097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 867/1729] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:42 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:42.437842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0fbd5-e7db-4232-97c6-45987f54a2a4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.438009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.443455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:42.443953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.444564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.444849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.445133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.446366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.447979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.451462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab595b9-b8cc-427e-8cf8-13f9afb75836 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.456819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.457420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.457701 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.457977 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.458627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.458745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 863/1730] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:42.462518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.462596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.471754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54dbe4-ce19-45bf-adcd-5af264a15368 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.477066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.477832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.478117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.478393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] PATH_INFO: `/v3/projects/4fd280cd0ae7497a99b5f724438df923/users/3c5d0e10b13d4abc89e5b16eb7083297/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.480434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd280cd0ae7497a99b5f724438df923, user_id=3c5d0e10b13d4abc89e5b16eb7083297, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.483179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.490043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 868/1731] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:42.491644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.497390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 864/1732] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:42 2022] PUT /identity/v3/projects/4fd280cd0ae7497a99b5f724438df923/users/3c5d0e10b13d4abc89e5b16eb7083297/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:42.498795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.514300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d689-d998-4598-a2ef-f927744bb93a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.591920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5795f-2cf6-49a7-a731-57b795d62b97 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.594091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.594716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.595110 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.595455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.596615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.597902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.601836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bf7f9-2b5c-4539-b46e-3cd97757584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.602579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf7f9-2b5c-4539-b46e-3cd97757584c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.602947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf7f9-2b5c-4539-b46e-3cd97757584c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.603296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf7f9-2b5c-4539-b46e-3cd97757584c admin admin] PATH_INFO: `/v3/projects/ac8a75ceba6c4cb6b882f44112bcca18/users/04ce3b8ceb29435a90738a4107cee8c1/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.605471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bf7f9-2b5c-4539-b46e-3cd97757584c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8a75ceba6c4cb6b882f44112bcca18, user_id=04ce3b8ceb29435a90738a4107cee8c1, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.608594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bf7f9-2b5c-4539-b46e-3cd97757584c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.623284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 869/1733] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:42.624336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.625700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 865/1734] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:42 2022] PUT /identity/v3/projects/ac8a75ceba6c4cb6b882f44112bcca18/users/04ce3b8ceb29435a90738a4107cee8c1/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:42.627025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14294-9a21-4470-9959-45a9322e43b0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.627373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14294-9a21-4470-9959-45a9322e43b0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.627978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14294-9a21-4470-9959-45a9322e43b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.649370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e580f0d-0fc6-4afe-8621-cf63d91cfb36 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.667724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a9d14294-9a21-4470-9959-45a9322e43b0 None None] MFA Rules not processed for user `3c5d0e10b13d4abc89e5b16eb7083297`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:42.669258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a9d14294-9a21-4470-9959-45a9322e43b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:42.719950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.720627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.720908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.721480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.722269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.723868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.740245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 870/1735] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:42.741182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.752702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783e106-1c38-45c7-9a68-2900785a1383 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.758241 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.759780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.759780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.759780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.760609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.762207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.777969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 866/1736] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:42.777969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1956eb-6814-4ad0-9852-83457c2f0da2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.777969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1956eb-6814-4ad0-9852-83457c2f0da2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.777969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1956eb-6814-4ad0-9852-83457c2f0da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.788094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 871/1737] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:42.789116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.801117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45539fad-0f43-4c93-8beb-34fcbde65c4d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.805862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.806614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.806902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.807172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] PATH_INFO: `/v3/projects/f5d63dce177a45aeb6e6623943090288/users/ac130700f0c64c9784de6ddd04def5e4/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:42.808904 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8f1956eb-6814-4ad0-9852-83457c2f0da2 None None] MFA Rules not processed for user `04ce3b8ceb29435a90738a4107cee8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:42.810185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8f1956eb-6814-4ad0-9852-83457c2f0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:42.832537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:42.839253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d63dce177a45aeb6e6623943090288, user_id=ac130700f0c64c9784de6ddd04def5e4, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:42.842257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:42.859531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 872/1738] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:42 2022] PUT /identity/v3/projects/f5d63dce177a45aeb6e6623943090288/users/ac130700f0c64c9784de6ddd04def5e4/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:42.860989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.862644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:42.915242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 867/1739] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:42.916931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1956eb-6814-4ad0-9852-83457c2f0da2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:42.923955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:42.928723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd769b-c6e7-4e6a-af89-cd98d7898a69 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.933827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1956eb-6814-4ad0-9852-83457c2f0da2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:42.935337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39730cf-3c6a-43ee-9158-842ee63eeb62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:42.936106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39730cf-3c6a-43ee-9158-842ee63eeb62 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:42.936760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39730cf-3c6a-43ee-9158-842ee63eeb62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:42.937147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39730cf-3c6a-43ee-9158-842ee63eeb62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.001944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.002624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.002908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.003178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] PATH_INFO: `/v3/projects/f14d4b1b605743519ed592e3bfe3c381/users/0cf855944dfe40379282417d3ce44699/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.008939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39730cf-3c6a-43ee-9158-842ee63eeb62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.010622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39730cf-3c6a-43ee-9158-842ee63eeb62 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.020333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14d4b1b605743519ed592e3bfe3c381, user_id=0cf855944dfe40379282417d3ce44699, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.021646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 873/1740] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:43.022949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.023198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdb6c-c77d-4e37-91d2-f9108e13e1ae None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.023648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdb6c-c77d-4e37-91d2-f9108e13e1ae None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.024202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdb6c-c77d-4e37-91d2-f9108e13e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.038585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 868/1741] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:42 2022] PUT /identity/v3/projects/f14d4b1b605743519ed592e3bfe3c381/users/0cf855944dfe40379282417d3ce44699/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:43.039508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.041320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.061522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fa9bdb6c-c77d-4e37-91d2-f9108e13e1ae None None] MFA Rules not processed for user `ac130700f0c64c9784de6ddd04def5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:43.062948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fa9bdb6c-c77d-4e37-91d2-f9108e13e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.099879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01c8f-e4ea-40af-bb4e-cbdbd5c8bd23 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.103522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.104150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.104454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.104724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.128036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 874/1742] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:43.129301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee91dff-c1df-4ffd-9b4e-22b67268dabf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.129616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee91dff-c1df-4ffd-9b4e-22b67268dabf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.129887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee91dff-c1df-4ffd-9b4e-22b67268dabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.155123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:43.158171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4ee91dff-c1df-4ffd-9b4e-22b67268dabf None None] MFA Rules not processed for user `0cf855944dfe40379282417d3ce44699`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:43.159754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4ee91dff-c1df-4ffd-9b4e-22b67268dabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.169794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.171248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.181535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 869/1743] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:43.182391 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.239025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 875/1744] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:43.240041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee91dff-c1df-4ffd-9b4e-22b67268dabf None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.256167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70749036-9587-4da7-9ac8-88958af78720 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.264102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:43.264382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.265152 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.265545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.265845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] PATH_INFO: `/v3/users/c6ea4166aab04526b778a181b1f1bf67` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.267200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ea4166aab04526b778a181b1f1bf67)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.269216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.317914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee91dff-c1df-4ffd-9b4e-22b67268dabf None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.321047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ea4166aab04526b778a181b1f1bf67'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:43.322054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ea4166aab04526b778a181b1f1bf67'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:43.323317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.324079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.324439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.324715 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.325423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.327985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.330654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ea4166aab04526b778a181b1f1bf67'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:43.331475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ea4166aab04526b778a181b1f1bf67'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:43.347512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ea4166aab04526b778a181b1f1bf67'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:43.360439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 876/1745] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:43 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:43.360439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.360439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.371881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 870/1746] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:43 2022] DELETE /identity/v3/users/c6ea4166aab04526b778a181b1f1bf67 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:43.372864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.374384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.420733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bd68d-72ce-41da-b736-a858bb5c1f3c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.445664 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e7605-e7da-452a-80f2-e3f7febd078b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.451219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.451854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.452140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.452532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.453183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.455337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.466539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:43.479828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98efc7e-f7fa-422b-b72b-c3c286c4a0c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.480462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98efc7e-f7fa-422b-b72b-c3c286c4a0c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.480742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98efc7e-f7fa-422b-b72b-c3c286c4a0c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.481196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98efc7e-f7fa-422b-b72b-c3c286c4a0c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.483524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b98efc7e-f7fa-422b-b72b-c3c286c4a0c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.489597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 871/1747] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:43 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:43.489597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.491359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.503833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507333e-20f1-463b-88cf-9ab662f16b11 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.509628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.510230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.510514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.510790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.512972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.545320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98efc7e-f7fa-422b-b72b-c3c286c4a0c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.546820 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98efc7e-f7fa-422b-b72b-c3c286c4a0c9 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.557663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 877/1748] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:43.558899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.559190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.559556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.576685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.578192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.579304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:43.580533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.588325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 872/1749] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:43.592149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 878/1750] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:43.597126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.598729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.600724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.611888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:43.614839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97efc8-afb9-4912-a85a-85e2890f23fd service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.623619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.624373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.624831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.625321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.626417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.629295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.641738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 873/1751] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:43.645864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.656681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198616b7-2f61-4bd6-8a96-830bafcc37db admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.664131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.664805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.665503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.665878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.666623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.668518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.673690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafc744-b3b4-4ea4-9fe7-e33f355efbd0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.679594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385f14c-7287-4763-8fb8-463c176de525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.680364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385f14c-7287-4763-8fb8-463c176de525 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.680645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385f14c-7287-4763-8fb8-463c176de525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.680915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385f14c-7287-4763-8fb8-463c176de525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.687915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 874/1752] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:43.689331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:43.696079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385f14c-7287-4763-8fb8-463c176de525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.697554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385f14c-7287-4763-8fb8-463c176de525 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.700624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530966-92e3-4f59-9f31-595abd06568a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:43.705717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:43.706538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.707064 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.707393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] PATH_INFO: `/v3/projects/bf7fa3f797164581badca3c3ff3fcf7e/users/33446b30274c4117b0448d51b559b958/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.712251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 879/1753] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:43.733359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7fa3f797164581badca3c3ff3fcf7e, user_id=33446b30274c4117b0448d51b559b958, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:43.736954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:43.756697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 875/1754] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:43 2022] PUT /identity/v3/projects/bf7fa3f797164581badca3c3ff3fcf7e/users/33446b30274c4117b0448d51b559b958/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:43.767213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15494-ba57-4289-8339-4735e2072f69 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:43.767637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15494-ba57-4289-8339-4735e2072f69 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:43.768103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15494-ba57-4289-8339-4735e2072f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:43.808961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2ce15494-ba57-4289-8339-4735e2072f69 None None] MFA Rules not processed for user `33446b30274c4117b0448d51b559b958`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:43.810267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2ce15494-ba57-4289-8339-4735e2072f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:43.918623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 880/1755] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:43.925407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.031638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e01a-b49f-4919-abf6-0a9fc0b3da8e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.039133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.040039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.040039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.040282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.041086 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.043216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.092589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 876/1756] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:43 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:44.098257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15494-ba57-4289-8339-4735e2072f69 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.111496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15494-ba57-4289-8339-4735e2072f69 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.130078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.132519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:44.176986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:44.203660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.204323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.204605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.204884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.205644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.208328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.212345 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4c9c-0224-44ef-a8d3-40393500a339 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.219312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.220059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.220276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.220549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] PATH_INFO: `/v3/projects/28db168621bb4479a98cfaed9fc50288` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.222351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28db168621bb4479a98cfaed9fc50288)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.224371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.240222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 881/1757] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:44 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:44.241290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.253323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de576-71d0-4021-ae88-f5dc183f25b2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.258828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.259487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.259775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.260079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.260790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.262423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.273256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 882/1758] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:44.277239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.277824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28db168621bb4479a98cfaed9fc50288', 'request_id': 'req-e6488e8f-ff5f-4e5d-9928-9469119986e7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.286528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28db168621bb4479a98cfaed9fc50288', 'request_id': 'req-e6488e8f-ff5f-4e5d-9928-9469119986e7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.286988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909718-1b6a-4704-8e6d-0ec985b0993b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.292842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28db168621bb4479a98cfaed9fc50288', 'request_id': 'req-e6488e8f-ff5f-4e5d-9928-9469119986e7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.300558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:44.305630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] The token cache is being invalidate because project 28db168621bb4479a98cfaed9fc50288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:44.305923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.306630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.308300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 877/1759] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:44 2022] DELETE /identity/v3/projects/28db168621bb4479a98cfaed9fc50288 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:44.312114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.313550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:44.353102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.353844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.354160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.354436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] PATH_INFO: `/v3/projects/a94fbc07b1c34c20815cd3f73fbfc7f2/users/63181a7fb24647e5bab0b3a9454075f8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.370407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94fbc07b1c34c20815cd3f73fbfc7f2, user_id=63181a7fb24647e5bab0b3a9454075f8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.373119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.379442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488e8f-ff5f-4e5d-9928-9469119986e7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.386274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 883/1760] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:44 2022] PUT /identity/v3/projects/a94fbc07b1c34c20815cd3f73fbfc7f2/users/63181a7fb24647e5bab0b3a9454075f8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:44.390047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.391617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:44.436421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.436978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.437258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.437532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] PATH_INFO: `/v3/users/3c5d0e10b13d4abc89e5b16eb7083297` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.438696 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5d0e10b13d4abc89e5b16eb7083297)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.440663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.453358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:44.455271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd50c77-9cc2-46c8-886e-6b5d975f6aa1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.460117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.460724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.461006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.461275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.461922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.463516 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.474573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 884/1761] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:44.478554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.491392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891be66b-c3bd-47c1-b74e-488b10dad461 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.496873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ff03e-6646-41aa-b2a8-325c81bec695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.497540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ff03e-6646-41aa-b2a8-325c81bec695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.497671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5d0e10b13d4abc89e5b16eb7083297'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.497825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ff03e-6646-41aa-b2a8-325c81bec695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.498109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ff03e-6646-41aa-b2a8-325c81bec695 admin admin] PATH_INFO: `/v3/projects/a94fbc07b1c34c20815cd3f73fbfc7f2/users/63181a7fb24647e5bab0b3a9454075f8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.498335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5d0e10b13d4abc89e5b16eb7083297'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.500272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ff03e-6646-41aa-b2a8-325c81bec695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94fbc07b1c34c20815cd3f73fbfc7f2, user_id=63181a7fb24647e5bab0b3a9454075f8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.503183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ff03e-6646-41aa-b2a8-325c81bec695 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.507140 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5d0e10b13d4abc89e5b16eb7083297'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.508135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5d0e10b13d4abc89e5b16eb7083297'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.516025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 885/1762] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:44 2022] PUT /identity/v3/projects/a94fbc07b1c34c20815cd3f73fbfc7f2/users/63181a7fb24647e5bab0b3a9454075f8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:44.526437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.526647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.526930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.528596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5d0e10b13d4abc89e5b16eb7083297'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:44.544535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 878/1763] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:44 2022] DELETE /identity/v3/users/3c5d0e10b13d4abc89e5b16eb7083297 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:44.560847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] MFA Rules not processed for user `63181a7fb24647e5bab0b3a9454075f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:44.562247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:44.647222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 886/1764] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:44.659872 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.661292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:44.721115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824723da-ecf3-4301-b611-1ccabfe86a84 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.729148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72a9fb-412a-44a8-8ac6-9c7a3529bc87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.730174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72a9fb-412a-44a8-8ac6-9c7a3529bc87 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.730462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72a9fb-412a-44a8-8ac6-9c7a3529bc87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.730943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72a9fb-412a-44a8-8ac6-9c7a3529bc87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.733193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8e72a9fb-412a-44a8-8ac6-9c7a3529bc87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:44.798830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72a9fb-412a-44a8-8ac6-9c7a3529bc87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.800448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72a9fb-412a-44a8-8ac6-9c7a3529bc87 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:44.810335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 879/1765] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:44.858164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:44.860696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:44.888381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:44.947844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e625-5e2b-4456-b94f-cd90ed5ff674 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:44.953224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:44.953933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:44.954276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:44.954546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] PATH_INFO: `/v3/projects/4fd280cd0ae7497a99b5f724438df923` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:44.955680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd280cd0ae7497a99b5f724438df923)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:44.957648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.028227 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd280cd0ae7497a99b5f724438df923', 'request_id': 'req-216c58f3-75a9-48c4-bdcc-2bef780a7597'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:45.036534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd280cd0ae7497a99b5f724438df923', 'request_id': 'req-216c58f3-75a9-48c4-bdcc-2bef780a7597'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:45.046384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd280cd0ae7497a99b5f724438df923', 'request_id': 'req-216c58f3-75a9-48c4-bdcc-2bef780a7597'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:45.059497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] The token cache is being invalidate because project 4fd280cd0ae7497a99b5f724438df923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:45.059871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:45.061092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-216c58f3-75a9-48c4-bdcc-2bef780a7597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:45.066739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 887/1766] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:44 2022] DELETE /identity/v3/projects/4fd280cd0ae7497a99b5f724438df923 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:45.068215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7895967-bfbe-459a-a92b-75afedc8ecf9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.068587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7895967-bfbe-459a-a92b-75afedc8ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.068933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7895967-bfbe-459a-a92b-75afedc8ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.104969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a7895967-bfbe-459a-a92b-75afedc8ecf9 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:45.106429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a7895967-bfbe-459a-a92b-75afedc8ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:45.191774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:45.274335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 880/1767] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:45.282169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a3dbb-4ff7-4f4c-a325-6a358d7f87c7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.282370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a3dbb-4ff7-4f4c-a325-6a358d7f87c7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.282664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a3dbb-4ff7-4f4c-a325-6a358d7f87c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.327527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d16a3dbb-4ff7-4f4c-a325-6a358d7f87c7 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:45.330413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d16a3dbb-4ff7-4f4c-a325-6a358d7f87c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:45.348467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 888/1768] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:45.354083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7895967-bfbe-459a-a92b-75afedc8ecf9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.366324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7895967-bfbe-459a-a92b-75afedc8ecf9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:45.371246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:45.371895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.372275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.372532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.373365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:45.373725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:45.375518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.393667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 881/1769] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:45.397394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a3dbb-4ff7-4f4c-a325-6a358d7f87c7 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.408316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a3dbb-4ff7-4f4c-a325-6a358d7f87c7 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:45.415524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:45.416388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.416980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.417591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.418233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:45.420179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.459882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 889/1770] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:45 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:45.461146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.470997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293b1a9-9043-4c7c-be94-8fb93d0f02b9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:45.528123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:45.528652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.528937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.529220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.529891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:45.531933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.552330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 882/1771] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:45 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:45.556519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.566741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248273a-eeb4-4c4a-be0f-2ee33248f70a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:45.572094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:45.572681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.572960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.573229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.573862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:45.575449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.585762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 890/1772] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:45.589522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.599232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110354-319c-48d7-872b-d6446205f753 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:45.603749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ca778-dcce-433e-887e-469d9f793403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:45.604357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ca778-dcce-433e-887e-469d9f793403 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.604631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ca778-dcce-433e-887e-469d9f793403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.604899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ca778-dcce-433e-887e-469d9f793403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.605533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ca778-dcce-433e-887e-469d9f793403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:45.607352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ca778-dcce-433e-887e-469d9f793403 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.617554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 883/1773] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:45.621558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.632320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87372e75-710f-48e0-b53a-7dc2672f6782 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:45.638570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:45.639224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.639506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.639780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] PATH_INFO: `/v3/projects/9e7b1b3b80e346fc8cb6bbdc988d1f32/users/3150757819034efab44ae2da6a107f8b/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.656099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7b1b3b80e346fc8cb6bbdc988d1f32, user_id=3150757819034efab44ae2da6a107f8b, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:45.658735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.672625 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 891/1774] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:45 2022] PUT /identity/v3/projects/9e7b1b3b80e346fc8cb6bbdc988d1f32/users/3150757819034efab44ae2da6a107f8b/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:45.684853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ffce-12f9-4979-81e5-cccb89236877 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.685405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ffce-12f9-4979-81e5-cccb89236877 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.685862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ffce-12f9-4979-81e5-cccb89236877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.720741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9223ffce-12f9-4979-81e5-cccb89236877 None None] MFA Rules not processed for user `3150757819034efab44ae2da6a107f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:45.722166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9223ffce-12f9-4979-81e5-cccb89236877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:45.807249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 884/1775] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:45.812378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.860668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:45.886494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd375-de17-4fef-b013-2310d4d3b5e8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:45.891521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:45.892233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:45.892514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:45.892790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:45.893436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:45.895566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:45.930786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 892/1776] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:45 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:45.935437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ffce-12f9-4979-81e5-cccb89236877 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:45.948625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ffce-12f9-4979-81e5-cccb89236877 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.040257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:46.065066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.065695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.066013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.066320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.066959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.069468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.092109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 885/1777] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:45 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:46.096646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.109442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ee50a-398f-44d6-a490-2045ae8fef7f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.116415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.117268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.117656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.118027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.118912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.120776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.134824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 893/1778] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:46.139926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.151007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df45f5-fd6d-4a66-a568-a7fe851a034c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.158524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.159448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.159660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.159978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] PATH_INFO: `/v3/projects/47f9b30f00fa4fdd98825361c5100c74/users/160161b095bb4089b353ebf4fc6b5d62/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.184602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f9b30f00fa4fdd98825361c5100c74, user_id=160161b095bb4089b353ebf4fc6b5d62, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.187432 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.206508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 886/1779] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:46 2022] PUT /identity/v3/projects/47f9b30f00fa4fdd98825361c5100c74/users/160161b095bb4089b353ebf4fc6b5d62/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:46.210652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.223563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051df95-d328-4a07-bdbf-36c9139c6888 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.320319 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.320991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.321292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.321975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.322639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.324318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.343684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.347050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:46.349274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 894/1780] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:46.352894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.381963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b899-8bb3-4947-8a24-3aea0fb63497 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.383176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0ac2d-ec51-43c5-bad9-0c4e2405c287 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.393330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.393943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.394485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.394485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] PATH_INFO: `/v3/users/0cf855944dfe40379282417d3ce44699` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.395781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846b7c0-d0be-40f1-8d75-3cf9b1505490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.396477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b7c0-d0be-40f1-8d75-3cf9b1505490 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.396752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b7c0-d0be-40f1-8d75-3cf9b1505490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.397024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b7c0-d0be-40f1-8d75-3cf9b1505490 admin admin] PATH_INFO: `/v3/projects/47f9b30f00fa4fdd98825361c5100c74/users/160161b095bb4089b353ebf4fc6b5d62/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.399123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf855944dfe40379282417d3ce44699)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.401059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.402627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846b7c0-d0be-40f1-8d75-3cf9b1505490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f9b30f00fa4fdd98825361c5100c74, user_id=160161b095bb4089b353ebf4fc6b5d62, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.407912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846b7c0-d0be-40f1-8d75-3cf9b1505490 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.441676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 895/1781] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:46 2022] PUT /identity/v3/projects/47f9b30f00fa4fdd98825361c5100c74/users/160161b095bb4089b353ebf4fc6b5d62/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:46.456385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3c18-b018-4115-aad5-2a1f02cb1223 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.456722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3c18-b018-4115-aad5-2a1f02cb1223 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.456941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3c18-b018-4115-aad5-2a1f02cb1223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.549526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf855944dfe40379282417d3ce44699'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:46.551480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf855944dfe40379282417d3ce44699'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:46.569409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-897a3c18-b018-4115-aad5-2a1f02cb1223 None None] MFA Rules not processed for user `160161b095bb4089b353ebf4fc6b5d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:46.573116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-897a3c18-b018-4115-aad5-2a1f02cb1223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:46.575874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf855944dfe40379282417d3ce44699'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:46.576631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf855944dfe40379282417d3ce44699'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:46.616020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf855944dfe40379282417d3ce44699'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:46.638819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 887/1782] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:46 2022] DELETE /identity/v3/users/0cf855944dfe40379282417d3ce44699 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:46.643244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.644794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:46.711870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 896/1783] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:46.713154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.713446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.713722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.728244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489bda2-be6f-4da9-bcb6-ec5c637fb86a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.732942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.733558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.733839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.734426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.735048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:46.736929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:46.737355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:46.754558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:46.804275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:46.818593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 897/1784] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:46.819844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.821328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:46.835167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d6869-84c4-4c09-b5ee-4cafab389e84 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.838948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.839564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.839865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.840139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.843961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.845548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.856953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 888/1785] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:46.857653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:46.859074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:46.915536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.917689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.932710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf6fb2-7d14-4f2c-b0c2-48a112811675 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:46.934565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 898/1786] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:46.945030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:46.945663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:46.945948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:46.946226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:46.970366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:46.974036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:46.988651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 889/1787] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:47.565735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:47.567696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:47.569513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:47.581977 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95765a2-825c-4ebe-9ae2-2b11287cb0a4 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:47.584914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b571a-8c05-4ea2-b900-951ce8b04cef service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:47.589770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:47.590689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:47.591533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:47.592056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:47.592351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] PATH_INFO: `/v3/projects/f14d4b1b605743519ed592e3bfe3c381` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:47.594560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14d4b1b605743519ed592e3bfe3c381)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:47.596925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:47.602343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:47.603414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:47.603632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:47.611382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:47.684306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14d4b1b605743519ed592e3bfe3c381', 'request_id': 'req-042938a9-d38a-4d5f-b4a5-78f1c4fba574'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:47.689966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14d4b1b605743519ed592e3bfe3c381', 'request_id': 'req-042938a9-d38a-4d5f-b4a5-78f1c4fba574'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:47.710147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14d4b1b605743519ed592e3bfe3c381', 'request_id': 'req-042938a9-d38a-4d5f-b4a5-78f1c4fba574'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:47.711550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:47.713650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:47.723690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 890/1788] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:47.725374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:47.725472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] The token cache is being invalidate because project f14d4b1b605743519ed592e3bfe3c381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:47.725682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:47.726502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-042938a9-d38a-4d5f-b4a5-78f1c4fba574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:47.728869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 899/1789] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:47 2022] DELETE /identity/v3/projects/f14d4b1b605743519ed592e3bfe3c381 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:47.735036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49591a7e-f8c0-4394-abe9-498d94159f5c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:47.735389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49591a7e-f8c0-4394-abe9-498d94159f5c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:47.735739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49591a7e-f8c0-4394-abe9-498d94159f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:47.740464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b918eb-ccab-4061-99ee-768e2a26bc87 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:47.767673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-49591a7e-f8c0-4394-abe9-498d94159f5c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:47.769278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-49591a7e-f8c0-4394-abe9-498d94159f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:47.812286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:47.837330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:47.838330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:47.838921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:47.839666 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:47.842317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:47.873795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 900/1790] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:47.882530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e173d7-73b8-41c9-a738-30ad01712031 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:47.882931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e173d7-73b8-41c9-a738-30ad01712031 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:47.883595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e173d7-73b8-41c9-a738-30ad01712031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:47.885326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:47.909472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-14e173d7-73b8-41c9-a738-30ad01712031 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:47.912048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-14e173d7-73b8-41c9-a738-30ad01712031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:47.924950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 901/1791] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:47.929406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e173d7-73b8-41c9-a738-30ad01712031 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:47.939126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e173d7-73b8-41c9-a738-30ad01712031 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:47.943139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:47.945729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:47.952783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:47.953425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:47.953808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:47.954054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:47.954874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:47.955307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:47.957142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:47.961646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 891/1792] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:47.978827 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 902/1793] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:29:47.979401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:47.993401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f97a0-3bf7-43f1-afd7-7989f499a662 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:48.002478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:48.004295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:48.016125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:48.016125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:48.016125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:48.016125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:48.072103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 892/1794] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:47 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:48.072947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:48.089331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5705c-c994-4b93-b9ca-10416cbddb1b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:48.228875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:48.230798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:48.231172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:48.232612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:48.233369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:48.236933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:48.267859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 903/1795] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:48 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:48.268662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:48.282761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8f9e-70e0-4777-a8cb-7773cc8caeb5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:48.293230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:48.294306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:48.294615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:48.295001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:48.295675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:48.297720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:48.311775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 893/1796] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:48.316499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:48.345638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f05d6-6f5f-4e32-b452-d4e6a51c2e2d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:48.351345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3929b-7eec-45b4-93b1-7f96f7a8a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:48.352050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3929b-7eec-45b4-93b1-7f96f7a8a7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:48.352321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3929b-7eec-45b4-93b1-7f96f7a8a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:48.352597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3929b-7eec-45b4-93b1-7f96f7a8a7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:48.353240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3929b-7eec-45b4-93b1-7f96f7a8a7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:48.355251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3929b-7eec-45b4-93b1-7f96f7a8a7d3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:48.367844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 904/1797] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:48.370767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:48.381510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714f8f-5a21-4b15-864a-9e003c3183b3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:48.386057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:48.386703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:48.386985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:48.387253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] PATH_INFO: `/v3/projects/be434511df4246618777d7b2efce3130/users/3cd83d3b7c0b42bcba39432245512367/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:48.402792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be434511df4246618777d7b2efce3130, user_id=3cd83d3b7c0b42bcba39432245512367, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:48.405809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:48.420342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 894/1798] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:48 2022] PUT /identity/v3/projects/be434511df4246618777d7b2efce3130/users/3cd83d3b7c0b42bcba39432245512367/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:48.430910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:48.431289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:48.431625 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:48.463196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] MFA Rules not processed for user `3cd83d3b7c0b42bcba39432245512367`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:48.464685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:48.532256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 905/1799] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:48.544582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:48.546300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:48.608938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8a29-043a-4d0c-a8f4-10fab9710e4f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:48.612782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c650-7962-4999-8e88-2a16fb8908e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:48.613393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c650-7962-4999-8e88-2a16fb8908e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:48.613672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c650-7962-4999-8e88-2a16fb8908e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:48.613943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c650-7962-4999-8e88-2a16fb8908e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:48.622869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c650-7962-4999-8e88-2a16fb8908e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:48.624347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c650-7962-4999-8e88-2a16fb8908e6 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:48.634560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 895/1800] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:50.004677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:50.006495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:50.036208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:50.083815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e67b7d-291d-4d30-a045-002cfaf5b20a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:50.091482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:50.092254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:50.092547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:50.092929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] PATH_INFO: `/v3/users/1eb2b1cb33644ea8a6f56ef24b46610e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:50.094195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb2b1cb33644ea8a6f56ef24b46610e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:50.097206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:50.161320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb2b1cb33644ea8a6f56ef24b46610e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.162149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb2b1cb33644ea8a6f56ef24b46610e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.184545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb2b1cb33644ea8a6f56ef24b46610e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.185840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb2b1cb33644ea8a6f56ef24b46610e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.195201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb2b1cb33644ea8a6f56ef24b46610e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.211003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 906/1801] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:50 2022] DELETE /identity/v3/users/1eb2b1cb33644ea8a6f56ef24b46610e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:50.215722 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:50.216384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:50.216384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:50.247545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:50.248953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:50.315841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 896/1802] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:50.323360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:50.324806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:50.390366 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845221c0-6b53-4a5d-8711-e10dd8a5e7d1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:50.394083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eed8c-4737-41f9-be1e-150a3a31b3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:50.394695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eed8c-4737-41f9-be1e-150a3a31b3ff service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:50.394974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eed8c-4737-41f9-be1e-150a3a31b3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:50.395245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eed8c-4737-41f9-be1e-150a3a31b3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:50.404294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eed8c-4737-41f9-be1e-150a3a31b3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:50.405741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eed8c-4737-41f9-be1e-150a3a31b3ff service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:50.416261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 907/1803] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:50.807947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:50.809562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:50.822164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49aaf3-71aa-449d-af6d-7fcf43653442 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:50.829175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:50.829834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:50.830683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:50.830955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] PATH_INFO: `/v3/users/3150757819034efab44ae2da6a107f8b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:50.832099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3150757819034efab44ae2da6a107f8b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:50.834067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:50.841349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:50.889927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3150757819034efab44ae2da6a107f8b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.890659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3150757819034efab44ae2da6a107f8b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.900755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3150757819034efab44ae2da6a107f8b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.901841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3150757819034efab44ae2da6a107f8b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.917385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3150757819034efab44ae2da6a107f8b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:50.941828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 897/1804] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:50 2022] DELETE /identity/v3/users/3150757819034efab44ae2da6a107f8b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:50.943548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:50.943865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:50.944167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:50.967160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:50.968297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:51.014543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:51.052058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 908/1805] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:51.058467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:51.060466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:51.145500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2f41-a62b-4f20-ae50-8ecfdeb84588 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:51.151905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:51.152430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:51.152708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:51.153043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:51.164012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:51.165456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:51.174857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:51.176285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:51.187697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 898/1806] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:51.191383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a707-affd-460b-a7dd-3c20ecb78143 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:51.198784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:51.199605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:51.200375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:51.200375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] PATH_INFO: `/v3/projects/5f534253584949f791139f85ec5b2cf2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:51.201840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f534253584949f791139f85ec5b2cf2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:51.204921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:51.297872 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f534253584949f791139f85ec5b2cf2', 'request_id': 'req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.308975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f534253584949f791139f85ec5b2cf2', 'request_id': 'req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.319779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f534253584949f791139f85ec5b2cf2', 'request_id': 'req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.335132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] The token cache is being invalidate because project 5f534253584949f791139f85ec5b2cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:51.335350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.336080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.340041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 909/1807] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:51 2022] DELETE /identity/v3/projects/5f534253584949f791139f85ec5b2cf2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:51.343355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:51.354725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b293e-9b56-4de8-a6f5-fefb9fe4bfe5 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:51.436773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:51.438325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:51.439362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:51.439840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] PATH_INFO: `/v3/users/04ce3b8ceb29435a90738a4107cee8c1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:51.442614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ce3b8ceb29435a90738a4107cee8c1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:51.446342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:51.529358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:51.556289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ce3b8ceb29435a90738a4107cee8c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.557381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ce3b8ceb29435a90738a4107cee8c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.567742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:51.571662 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:51.572955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ce3b8ceb29435a90738a4107cee8c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.573910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ce3b8ceb29435a90738a4107cee8c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.593480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ce3b8ceb29435a90738a4107cee8c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.607828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 899/1808] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:51 2022] DELETE /identity/v3/users/04ce3b8ceb29435a90738a4107cee8c1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:51.612959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11b3f5-1e44-4a5e-9d09-02bc3ade74a9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:51.697281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:51.698388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:51.698815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:51.699043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] PATH_INFO: `/v3/projects/9e7b1b3b80e346fc8cb6bbdc988d1f32` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:51.700311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7b1b3b80e346fc8cb6bbdc988d1f32)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:51.702417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:51.778805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7b1b3b80e346fc8cb6bbdc988d1f32', 'request_id': 'req-e76444a8-e8b3-4574-bc68-b8143cd3dead'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.786190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7b1b3b80e346fc8cb6bbdc988d1f32', 'request_id': 'req-e76444a8-e8b3-4574-bc68-b8143cd3dead'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.798760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7b1b3b80e346fc8cb6bbdc988d1f32', 'request_id': 'req-e76444a8-e8b3-4574-bc68-b8143cd3dead'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.807661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:51.813391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] The token cache is being invalidate because project 9e7b1b3b80e346fc8cb6bbdc988d1f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:51.814197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.815426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.818692 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 910/1809] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:51 2022] DELETE /identity/v3/projects/9e7b1b3b80e346fc8cb6bbdc988d1f32 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:51.822631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:51.824169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:51.837995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28864-a20a-4884-8223-4276c5139d7a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:51.903858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:51.904969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:51.905261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:51.905591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] PATH_INFO: `/v3/users/160161b095bb4089b353ebf4fc6b5d62` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:51.907943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160161b095bb4089b353ebf4fc6b5d62)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:51.910532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:51.928162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:51.929717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:51.944267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76444a8-e8b3-4574-bc68-b8143cd3dead admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:51.950338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:51.951591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:51.952165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:51.952709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] PATH_INFO: `/v3/projects/ac8a75ceba6c4cb6b882f44112bcca18` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:51.954855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8a75ceba6c4cb6b882f44112bcca18)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:51.957305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:51.988369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160161b095bb4089b353ebf4fc6b5d62'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.989433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160161b095bb4089b353ebf4fc6b5d62'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.997846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160161b095bb4089b353ebf4fc6b5d62'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:51.998566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160161b095bb4089b353ebf4fc6b5d62'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.013757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c190e3e6-780b-42f3-aa76-d3ef0b722236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160161b095bb4089b353ebf4fc6b5d62'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.015709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8a75ceba6c4cb6b882f44112bcca18', 'request_id': 'req-5edbcbe9-6025-44e5-9ea8-932d326d4e40'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.023690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8a75ceba6c4cb6b882f44112bcca18', 'request_id': 'req-5edbcbe9-6025-44e5-9ea8-932d326d4e40'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.031548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 900/1810] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:51 2022] DELETE /identity/v3/users/160161b095bb4089b353ebf4fc6b5d62 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:52.037099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8a75ceba6c4cb6b882f44112bcca18', 'request_id': 'req-5edbcbe9-6025-44e5-9ea8-932d326d4e40'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.049819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] The token cache is being invalidate because project ac8a75ceba6c4cb6b882f44112bcca18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:52.050119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.050806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5edbcbe9-6025-44e5-9ea8-932d326d4e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.056260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 911/1811] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:51 2022] DELETE /identity/v3/projects/ac8a75ceba6c4cb6b882f44112bcca18 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:52.057782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e49167-5c5a-45a1-a265-5be1ea80c8e0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.058067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e49167-5c5a-45a1-a265-5be1ea80c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.058340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e49167-5c5a-45a1-a265-5be1ea80c8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.081835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-87e49167-5c5a-45a1-a265-5be1ea80c8e0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:52.083249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-87e49167-5c5a-45a1-a265-5be1ea80c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.105991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:52.167624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 901/1812] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:52.175242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5dcd-e2dd-4360-a2eb-faa76128b736 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.175564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5dcd-e2dd-4360-a2eb-faa76128b736 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.175840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5dcd-e2dd-4360-a2eb-faa76128b736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.208691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1fdc5dcd-e2dd-4360-a2eb-faa76128b736 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:52.209931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1fdc5dcd-e2dd-4360-a2eb-faa76128b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.221532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 912/1813] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:52.222575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e49167-5c5a-45a1-a265-5be1ea80c8e0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.232958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e49167-5c5a-45a1-a265-5be1ea80c8e0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:52.238027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:52.238653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.238937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.239214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.239925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:52.240238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:52.242051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:52.259380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 902/1814] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:29:52.260584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5dcd-e2dd-4360-a2eb-faa76128b736 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.272127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5dcd-e2dd-4360-a2eb-faa76128b736 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:52.296553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:52.297242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.297558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.297948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.298518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:52.302553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:52.326358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.328793 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.344115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a448bd-4a8e-4b13-b1c6-a7e2dbefd7aa admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:52.350544 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:52.351493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.352425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.352972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] PATH_INFO: `/v3/users/ac130700f0c64c9784de6ddd04def5e4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.354423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac130700f0c64c9784de6ddd04def5e4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:52.356983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:52.368272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 913/1815] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:52 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:52.370096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.438019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac130700f0c64c9784de6ddd04def5e4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.439404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac130700f0c64c9784de6ddd04def5e4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.451138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac130700f0c64c9784de6ddd04def5e4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.452269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac130700f0c64c9784de6ddd04def5e4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.466056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a950b1-662a-478d-b79e-eaef2b6cb44a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:52.469931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac130700f0c64c9784de6ddd04def5e4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.470862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ad1f5-09c0-4dee-8271-0f50f194ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:52.471478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad1f5-09c0-4dee-8271-0f50f194ca0b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.471769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad1f5-09c0-4dee-8271-0f50f194ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.472054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad1f5-09c0-4dee-8271-0f50f194ca0b admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.472691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ad1f5-09c0-4dee-8271-0f50f194ca0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:52.474681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ad1f5-09c0-4dee-8271-0f50f194ca0b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:52.484762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 903/1816] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:52 2022] DELETE /identity/v3/users/ac130700f0c64c9784de6ddd04def5e4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:52.488157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.488157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.507626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 914/1817] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:52 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:52.509161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.509522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.509868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.549560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:52.550870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.612149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:52.617779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ebeac-a2f1-432e-923c-fc3abfd466d0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:52.623701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:52.624375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.625153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.625394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] PATH_INFO: `/v3/projects/47f9b30f00fa4fdd98825361c5100c74` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.627461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f9b30f00fa4fdd98825361c5100c74)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:52.630335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:52.643983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 915/1818] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:52.645861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.650773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.677396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63a9a2-8fae-4855-86bb-c543408f5b57 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:52.680512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:52.694569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:52.695210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:52.696735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:52.697024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:52.698468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:52.703293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:52.730999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 916/1819] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:52.731869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.736817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.754316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f9b30f00fa4fdd98825361c5100c74', 'request_id': 'req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.777120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f9b30f00fa4fdd98825361c5100c74', 'request_id': 'req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.796688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f9b30f00fa4fdd98825361c5100c74', 'request_id': 'req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.836900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] The token cache is being invalidate because project 47f9b30f00fa4fdd98825361c5100c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:52.837196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.845841 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:52.847997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 904/1820] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:52 2022] DELETE /identity/v3/projects/47f9b30f00fa4fdd98825361c5100c74 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:52.855651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:52.857107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:52.945260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb646e5-ee82-4cb8-aa2f-68d1179ccec1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.022472 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5ab37-b59c-43f1-ad59-2c7aec62b009 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.034516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f90b8-a5cb-4da1-bec9-685b99aab738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.035578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f90b8-a5cb-4da1-bec9-685b99aab738 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.036127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f90b8-a5cb-4da1-bec9-685b99aab738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.036446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f90b8-a5cb-4da1-bec9-685b99aab738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.037331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f90b8-a5cb-4da1-bec9-685b99aab738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.039411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f90b8-a5cb-4da1-bec9-685b99aab738 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.070321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 905/1821] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:53.074137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565131-c13a-44b6-8055-89a9f0617d04 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.075241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565131-c13a-44b6-8055-89a9f0617d04 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.077035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565131-c13a-44b6-8055-89a9f0617d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.127749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b3565131-c13a-44b6-8055-89a9f0617d04 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:53.129278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b3565131-c13a-44b6-8055-89a9f0617d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:53.152809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 906/1822] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:53.153488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565131-c13a-44b6-8055-89a9f0617d04 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.169798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a9373-3304-4ec9-8267-2f0b5540892e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.172065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9373-3304-4ec9-8267-2f0b5540892e service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.172659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9373-3304-4ec9-8267-2f0b5540892e service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.173197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9373-3304-4ec9-8267-2f0b5540892e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.174084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565131-c13a-44b6-8055-89a9f0617d04 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.177140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f11a9373-3304-4ec9-8267-2f0b5540892e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:53.188912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce940-b39c-4299-9b27-21d3d802de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.189478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce940-b39c-4299-9b27-21d3d802de84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.189766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce940-b39c-4299-9b27-21d3d802de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.190055 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce940-b39c-4299-9b27-21d3d802de84 admin admin] PATH_INFO: `/v3/projects/5b5ba50c4b104cef90b541a6a31b5d39/users/555285fdd62541df90c0cdc229196ec3/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.194494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a9373-3304-4ec9-8267-2f0b5540892e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.196450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a9373-3304-4ec9-8267-2f0b5540892e service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.207500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce940-b39c-4299-9b27-21d3d802de84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5ba50c4b104cef90b541a6a31b5d39, user_id=555285fdd62541df90c0cdc229196ec3, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.208816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 917/1823] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:53.210341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce940-b39c-4299-9b27-21d3d802de84 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.210585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee108e-0eb0-4829-9e6b-3ef42b973a3e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.211159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee108e-0eb0-4829-9e6b-3ef42b973a3e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.211656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee108e-0eb0-4829-9e6b-3ef42b973a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.229430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 907/1824] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:53 2022] PUT /identity/v3/projects/5b5ba50c4b104cef90b541a6a31b5d39/users/555285fdd62541df90c0cdc229196ec3/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:53.241332 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.241865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.241865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.248770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d0ee108e-0eb0-4829-9e6b-3ef42b973a3e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:53.250698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d0ee108e-0eb0-4829-9e6b-3ef42b973a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:53.286548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] MFA Rules not processed for user `555285fdd62541df90c0cdc229196ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:53.287772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:53.360306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 918/1825] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:53.364343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee108e-0eb0-4829-9e6b-3ef42b973a3e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.378648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee108e-0eb0-4829-9e6b-3ef42b973a3e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.384714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.385358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.385650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.386303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.387531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:53.387889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.390711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.392849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 908/1826] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:53.410768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.412912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:53.421354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 919/1827] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:29:53.423172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.432842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:53.438282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251265d6-54c9-412b-8c9d-32face3f255f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.444789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.445409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.445696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.445976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.446620 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.449987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.477509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:53.494749 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 920/1828] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:53 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:53.498492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.547679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a172-e83f-49f6-82a5-0c4f848326f0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.607733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218b91f-745b-44b9-b07e-c827c17cebc0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.615928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.616561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.616982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.617259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.618036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.620512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.645692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.646639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.647136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.647625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.651968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 921/1829] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:53 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:53.655975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.677660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222a4c-21eb-4dec-a4d3-c6981dd1125b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.699301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.700394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.700544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.700824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.701575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.704129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.740969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 922/1830] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:53.745273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.753902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.755497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.760302 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bba4c2-5631-43a6-a02e-dbe6f7779cec admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.767566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.769039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.769530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.769990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.770967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.773121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.784134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 909/1831] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:53.791178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.799071 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 923/1832] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:53.806020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a88eba-5e71-4e3d-bbab-1cf592b34ed6 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.810875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.811609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.811999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.812382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] PATH_INFO: `/v3/users/555285fdd62541df90c0cdc229196ec3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.813814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555285fdd62541df90c0cdc229196ec3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.815195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:53.824792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.831470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846b8f5-1797-4fd6-acf6-8ad41f26d9cf admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:53.843118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252acafb-576c-4bd1-ad78-fb19f7f1b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:53.844404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252acafb-576c-4bd1-ad78-fb19f7f1b0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.844689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252acafb-576c-4bd1-ad78-fb19f7f1b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.844956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252acafb-576c-4bd1-ad78-fb19f7f1b0b3 admin admin] PATH_INFO: `/v3/projects/4872ac2266174e1985ff082169ad8205/users/c261c3cd605d4d9fbb17e7cd163b5217/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.870423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252acafb-576c-4bd1-ad78-fb19f7f1b0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4872ac2266174e1985ff082169ad8205, user_id=c261c3cd605d4d9fbb17e7cd163b5217, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:53.873552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252acafb-576c-4bd1-ad78-fb19f7f1b0b3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:53.895193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555285fdd62541df90c0cdc229196ec3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:53.896152 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555285fdd62541df90c0cdc229196ec3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:53.911278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 924/1833] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:53 2022] PUT /identity/v3/projects/4872ac2266174e1985ff082169ad8205/users/c261c3cd605d4d9fbb17e7cd163b5217/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:53.921549 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:53.922467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:53.922756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:53.930155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555285fdd62541df90c0cdc229196ec3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:53.930815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555285fdd62541df90c0cdc229196ec3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:53.964149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b0f6b7d3-469a-4f08-858d-d21919624c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555285fdd62541df90c0cdc229196ec3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:53.965437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:54.003689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 910/1834] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:53 2022] DELETE /identity/v3/users/555285fdd62541df90c0cdc229196ec3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:54.005169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:54.005469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:54.005864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:54.017119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] MFA Rules not processed for user `c261c3cd605d4d9fbb17e7cd163b5217`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:54.019913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.073552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:54.075397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.209187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 925/1835] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:54.210140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:54.211457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.219593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 911/1836] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:54.219593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:54.224070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.232438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2afb73-9062-48da-aca6-2346353c9eb7 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:54.239383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:54.240149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:54.240438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:54.240973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] PATH_INFO: `/v3/projects/f5d63dce177a45aeb6e6623943090288` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:54.242359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d63dce177a45aeb6e6623943090288)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:54.244714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:54.261731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd004eb6-cdc3-4644-9197-c477bfb7e058 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:54.275903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:54.277131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:54.277700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:54.278059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:54.282667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:54.287757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:54.298288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:54.328726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d63dce177a45aeb6e6623943090288', 'request_id': 'req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.344448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d63dce177a45aeb6e6623943090288', 'request_id': 'req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.358473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 912/1837] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:54 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:54.359406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:54.362879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.379216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d63dce177a45aeb6e6623943090288', 'request_id': 'req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.396275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] The token cache is being invalidate because project f5d63dce177a45aeb6e6623943090288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:54.396710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.397739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.402479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 926/1838] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:54 2022] DELETE /identity/v3/projects/f5d63dce177a45aeb6e6623943090288 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:54.402479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:54.403334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.503927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182c234-c49c-40bb-b496-a5855129526a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:54.518736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:54.518736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:54.518736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:54.519626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:54.521838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.523637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b66dbe-73e8-44e0-8e10-eb8d43507a7a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:54.601634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:54.602370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:54.602721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:54.603072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:54.603789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:54.606193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:54.644426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 927/1839] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:54 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:54.645742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:54.649116 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.686921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe96196-ba0c-4755-9487-b30cd597e21a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:54.694814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:54.695588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:54.696072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:54.696468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] PATH_INFO: `/v3/users/33446b30274c4117b0448d51b559b958` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:54.698130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33446b30274c4117b0448d51b559b958)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:54.700590 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:54.737087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:54.738798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:54.761694 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 913/1840] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:54.762725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:54.798099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:54.798267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39447-1060-4e32-9125-824317279812 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:54.801276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33446b30274c4117b0448d51b559b958'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.803734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33446b30274c4117b0448d51b559b958'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.809950 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:54.810634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:54.810925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:54.811238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:54.812617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:54.814498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:54.822168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33446b30274c4117b0448d51b559b958'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.823019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33446b30274c4117b0448d51b559b958'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.836227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 914/1841] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:54.839965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33446b30274c4117b0448d51b559b958'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:54.849276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:54.851677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:54.867870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 928/1842] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:54 2022] DELETE /identity/v3/users/33446b30274c4117b0448d51b559b958 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:54.897569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db8c4-05a2-4726-9eb6-654980a20260 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:54.901695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:55.009822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:55.010574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:55.010857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:55.011711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] PATH_INFO: `/v3/projects/1c893c65ff334fdb81684b3b66cdd4e2/users/8ddd90faf56a4564a4ffc99419597fc4/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:55.052063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c893c65ff334fdb81684b3b66cdd4e2, user_id=8ddd90faf56a4564a4ffc99419597fc4, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:55.053393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:55.083614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 915/1843] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:54 2022] PUT /identity/v3/projects/1c893c65ff334fdb81684b3b66cdd4e2/users/8ddd90faf56a4564a4ffc99419597fc4/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:55.087769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:55.105229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f7808-f209-480e-bf99-c2688846a503 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:55.268377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53682fea-650e-4065-80c6-1f9cce29b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:55.269058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53682fea-650e-4065-80c6-1f9cce29b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:55.269309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53682fea-650e-4065-80c6-1f9cce29b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:55.269613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53682fea-650e-4065-80c6-1f9cce29b3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:55.270282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53682fea-650e-4065-80c6-1f9cce29b3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:55.272498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53682fea-650e-4065-80c6-1f9cce29b3e3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:55.290113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 929/1844] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:55.294135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:55.309043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838060d1-ed81-405e-bcb1-e65d9267b9c4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:55.322958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:55.326093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:55.326093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:55.326093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] PATH_INFO: `/v3/projects/1c893c65ff334fdb81684b3b66cdd4e2/users/8ddd90faf56a4564a4ffc99419597fc4/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:55.334810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c893c65ff334fdb81684b3b66cdd4e2, user_id=8ddd90faf56a4564a4ffc99419597fc4, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:55.339706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:55.367730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 916/1845] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:55 2022] PUT /identity/v3/projects/1c893c65ff334fdb81684b3b66cdd4e2/users/8ddd90faf56a4564a4ffc99419597fc4/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:55.371717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:55.372258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:55.372687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:55.437718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] MFA Rules not processed for user `8ddd90faf56a4564a4ffc99419597fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:55.439275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:55.542681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 930/1846] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:55.557446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:55.559364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:55.580294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:55.581711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:55.653404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:55.670234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3cde-a419-4f65-a249-2ff38ec82ec4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:55.676771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:55.677012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c0c99-a40b-45f9-8d04-0ed8925533db None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:55.680691 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:55.680691 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:55.682122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:55.682743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:55.683410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:55.683812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:55.684186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] PATH_INFO: `/v3/projects/5b5ba50c4b104cef90b541a6a31b5d39` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:55.685381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5ba50c4b104cef90b541a6a31b5d39)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:55.688077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:55.705795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:55.712028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:55.750823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 917/1847] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:55.756672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:55.766503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:55.792443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b19df5-33e9-4df8-9ab2-b90e2a5b0292 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:55.827031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5ba50c4b104cef90b541a6a31b5d39', 'request_id': 'req-2773bb49-17bd-4786-848f-e289e17f26b0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:55.836425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5ba50c4b104cef90b541a6a31b5d39', 'request_id': 'req-2773bb49-17bd-4786-848f-e289e17f26b0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:55.856388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5ba50c4b104cef90b541a6a31b5d39', 'request_id': 'req-2773bb49-17bd-4786-848f-e289e17f26b0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:55.890925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] The token cache is being invalidate because project 5b5ba50c4b104cef90b541a6a31b5d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:55.890925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:55.890925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:55.899375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 931/1848] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:55 2022] DELETE /identity/v3/projects/5b5ba50c4b104cef90b541a6a31b5d39 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:55.899618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:55.900462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:55.900912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:55.901039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:55.901128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] PATH_INFO: `/v3/projects/bf7fa3f797164581badca3c3ff3fcf7e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:55.902215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7fa3f797164581badca3c3ff3fcf7e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:55.902327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:55.904169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:55.931425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:55.971477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7fa3f797164581badca3c3ff3fcf7e', 'request_id': 'req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:55.990357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7fa3f797164581badca3c3ff3fcf7e', 'request_id': 'req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:55.994794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773bb49-17bd-4786-848f-e289e17f26b0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:55.998295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7fa3f797164581badca3c3ff3fcf7e', 'request_id': 'req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.011342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] The token cache is being invalidate because project bf7fa3f797164581badca3c3ff3fcf7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:56.012044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.012778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-df0a1cd9-8e0b-489b-b5d6-6215b61cf9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.014620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 918/1849] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:55 2022] DELETE /identity/v3/projects/bf7fa3f797164581badca3c3ff3fcf7e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:56.015754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.016121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.016401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.037320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:56.039102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:56.052100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01b0e5-dd07-4181-a7ea-f5b6ea3d1348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.052721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01b0e5-dd07-4181-a7ea-f5b6ea3d1348 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.052998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01b0e5-dd07-4181-a7ea-f5b6ea3d1348 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.053267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01b0e5-dd07-4181-a7ea-f5b6ea3d1348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.057529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ed01b0e5-dd07-4181-a7ea-f5b6ea3d1348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:56.116521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:56.124631 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 919/1850] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:56.125595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.126913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:56.141642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01b0e5-dd07-4181-a7ea-f5b6ea3d1348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.143248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01b0e5-dd07-4181-a7ea-f5b6ea3d1348 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.146923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd657a5-d9ed-4723-a36d-d16e342255a0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:56.152827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.153480 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.153758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.154043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] PATH_INFO: `/v3/users/63181a7fb24647e5bab0b3a9454075f8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.155782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63181a7fb24647e5bab0b3a9454075f8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.157802 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.158618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 932/1851] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:56.160392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5fab-f618-4ac6-a697-3346f46cd478 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.160854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5fab-f618-4ac6-a697-3346f46cd478 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.161275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5fab-f618-4ac6-a697-3346f46cd478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.191849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bd9b5fab-f618-4ac6-a697-3346f46cd478 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:56.193471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bd9b5fab-f618-4ac6-a697-3346f46cd478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:56.209382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 933/1852] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:56.213754 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5fab-f618-4ac6-a697-3346f46cd478 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.227398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5fab-f618-4ac6-a697-3346f46cd478 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:56.233045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.234295 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.234592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.234914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.235574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:56.235963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.238497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.252645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 934/1853] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:29:56.258723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.270162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63181a7fb24647e5bab0b3a9454075f8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.271457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63181a7fb24647e5bab0b3a9454075f8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.275568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90559620-f4da-40d0-82a7-60550d773cdf admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:56.282382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.284271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.284409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63181a7fb24647e5bab0b3a9454075f8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.284740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.285121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.285902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.286176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63181a7fb24647e5bab0b3a9454075f8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.288106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.330060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63181a7fb24647e5bab0b3a9454075f8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:56.346986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 935/1854] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:56 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:56.348718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.350833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:56.352160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 920/1855] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:56 2022] DELETE /identity/v3/users/63181a7fb24647e5bab0b3a9454075f8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:56.433726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdbfd4-8f2f-4d2d-91d7-48a0cde13c23 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:56.549940 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.550916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.551341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.551857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.552936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.555370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.594282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 936/1856] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:56 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:56.606825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.623695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c119c4-d8a3-49e4-983b-b2e41ca25691 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:56.640209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.641831 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.642126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.642412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.643091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.648529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.679452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 921/1857] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:56.681269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.696922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e077bc-288f-459a-949e-a4327f8e01ed admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:56.704683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbad69f-87a3-4bf7-be38-3013f59d840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.705815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad69f-87a3-4bf7-be38-3013f59d840a admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.706605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad69f-87a3-4bf7-be38-3013f59d840a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.707198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad69f-87a3-4bf7-be38-3013f59d840a admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.708425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad69f-87a3-4bf7-be38-3013f59d840a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.711480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad69f-87a3-4bf7-be38-3013f59d840a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.752790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 937/1858] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:56.753306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.789527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3dd98-3fab-4b1c-bf1d-9c6200d9a6ee admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:56.796009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:56.797010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.797729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.798313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] PATH_INFO: `/v3/projects/7cca354a27664ecf8812ff8c8c202dae/users/693a44fb549d435eaae8d9372f92c223/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.811126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:56.829438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cca354a27664ecf8812ff8c8c202dae, user_id=693a44fb549d435eaae8d9372f92c223, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:56.833771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:56.864518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 922/1859] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:56 2022] PUT /identity/v3/projects/7cca354a27664ecf8812ff8c8c202dae/users/693a44fb549d435eaae8d9372f92c223/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:56.886312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:56.886615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:56.886897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:56.925722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] MFA Rules not processed for user `693a44fb549d435eaae8d9372f92c223`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:56.936387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:56.963469 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:56.987033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:56.988858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.038601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 938/1860] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:57.050860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.052573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.093253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afbd71-793a-4dd0-b35b-5bb1ae19ccc9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.100096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.100860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.101337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.101733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] PATH_INFO: `/v3/projects/a94fbc07b1c34c20815cd3f73fbfc7f2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.103042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94fbc07b1c34c20815cd3f73fbfc7f2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.105108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.128324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b5638-13eb-4a30-a44a-3cd41a013618 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.133370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.134096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.134262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.134537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.147006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.148485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.159391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 939/1861] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:29:57.160433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.160595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94fbc07b1c34c20815cd3f73fbfc7f2', 'request_id': 'req-546d8598-c75a-4ca2-abd8-45c81057d485'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.161825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.169985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94fbc07b1c34c20815cd3f73fbfc7f2', 'request_id': 'req-546d8598-c75a-4ca2-abd8-45c81057d485'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.177337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94fbc07b1c34c20815cd3f73fbfc7f2', 'request_id': 'req-546d8598-c75a-4ca2-abd8-45c81057d485'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.179679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5dbaa-4b77-452f-81df-eaa689484819 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.189652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] The token cache is being invalidate because project a94fbc07b1c34c20815cd3f73fbfc7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:57.190022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.190789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-546d8598-c75a-4ca2-abd8-45c81057d485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.192771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 923/1862] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:56 2022] DELETE /identity/v3/projects/a94fbc07b1c34c20815cd3f73fbfc7f2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:57.198475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6d41-c102-4cf9-838f-bd8ddcd2f818 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.199192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6d41-c102-4cf9-838f-bd8ddcd2f818 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.199542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6d41-c102-4cf9-838f-bd8ddcd2f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.222510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4c3a6d41-c102-4cf9-838f-bd8ddcd2f818 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:57.223645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4c3a6d41-c102-4cf9-838f-bd8ddcd2f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.248999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.249767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.250146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.250517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] PATH_INFO: `/v3/users/ca414f641d5946c1ba498ddeaf8cc25d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.251720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca414f641d5946c1ba498ddeaf8cc25d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.254033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.296994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 924/1863] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:57.306265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca43ed-c2fa-4d43-8a09-67395173a368 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.306643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca43ed-c2fa-4d43-8a09-67395173a368 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.306828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca43ed-c2fa-4d43-8a09-67395173a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.327919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2dca43ed-c2fa-4d43-8a09-67395173a368 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:57.329183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2dca43ed-c2fa-4d43-8a09-67395173a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.329924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca414f641d5946c1ba498ddeaf8cc25d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.331318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca414f641d5946c1ba498ddeaf8cc25d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.343061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 925/1864] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:57.352693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca43ed-c2fa-4d43-8a09-67395173a368 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.355561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:57.357165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca414f641d5946c1ba498ddeaf8cc25d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.358125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca414f641d5946c1ba498ddeaf8cc25d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.367446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca414f641d5946c1ba498ddeaf8cc25d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.367730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca43ed-c2fa-4d43-8a09-67395173a368 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.372796 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.373462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.373740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.374135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.374745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:57.375043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.376784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.383382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 940/1865] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:57 2022] DELETE /identity/v3/users/ca414f641d5946c1ba498ddeaf8cc25d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:57.384654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:57.397346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 926/1866] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:29:57.398988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.494569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a344888-184e-4303-a495-afdfc6a59321 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.500333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.501405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.501883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.502310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.503111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.505405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.557231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 941/1867] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:57 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:57.561218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.574352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc88b-8417-4ee8-a4bb-30bf994386e1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.665937 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.666765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.667060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.667357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.668124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.670715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.689354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.691526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.696507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 927/1868] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:57 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:29:57.700146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.705679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534909c2-f30a-4ca0-95ec-6c7b129a4410 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.711182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cb81b-244c-4339-aabf-412149afba8d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.711646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.712486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.712801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.713102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] PATH_INFO: `/v3/projects/c4e89ec199394cfb85d8ff18fa10f37a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.714294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e89ec199394cfb85d8ff18fa10f37a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.716769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.724712 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.725586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.726810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.727102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.727775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.729545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.741918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 928/1869] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:57.745678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.761046 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a71c96-6eae-48ed-a04c-9ffb38e73f24 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.761971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.762726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.763144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.763550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.764552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.765965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.784462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 929/1870] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:57.785758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:57.791206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e89ec199394cfb85d8ff18fa10f37a', 'request_id': 'req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.799036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffafb3-6d06-4679-844d-c09c7cc07446 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:57.800865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e89ec199394cfb85d8ff18fa10f37a', 'request_id': 'req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.811367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e89ec199394cfb85d8ff18fa10f37a', 'request_id': 'req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.826091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] The token cache is being invalidate because project c4e89ec199394cfb85d8ff18fa10f37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:29:57.826443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.827187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c6aa6823-b12e-48e7-8bf7-e9af6b194a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:29:57.832316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 942/1871] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:29:57 2022] DELETE /identity/v3/projects/c4e89ec199394cfb85d8ff18fa10f37a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:29:57.833644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aa5d9-1f4a-4b50-a701-97e71e2dfd70 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.834000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aa5d9-1f4a-4b50-a701-97e71e2dfd70 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.834348 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aa5d9-1f4a-4b50-a701-97e71e2dfd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.855162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-605aa5d9-1f4a-4b50-a701-97e71e2dfd70 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:57.856513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-605aa5d9-1f4a-4b50-a701-97e71e2dfd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.862808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153ec80-80d3-4f3a-b76e-58663ffa5d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:57.863604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ec80-80d3-4f3a-b76e-58663ffa5d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.863920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ec80-80d3-4f3a-b76e-58663ffa5d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.864244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ec80-80d3-4f3a-b76e-58663ffa5d49 admin admin] PATH_INFO: `/v3/projects/ee3a53fd2c8945449604c1aba0cf31cb/users/6feb382cd176428c97874a7121e18ffb/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.883539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153ec80-80d3-4f3a-b76e-58663ffa5d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3a53fd2c8945449604c1aba0cf31cb, user_id=6feb382cd176428c97874a7121e18ffb, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:57.887466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153ec80-80d3-4f3a-b76e-58663ffa5d49 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:57.910826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 930/1872] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:57 2022] PUT /identity/v3/projects/ee3a53fd2c8945449604c1aba0cf31cb/users/6feb382cd176428c97874a7121e18ffb/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:57.921316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.922113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.922398 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.924897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:57.954130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 943/1873] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:57.955775 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] MFA Rules not processed for user `6feb382cd176428c97874a7121e18ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:57.956265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c057-2678-4e39-8e9d-1607320c0328 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:57.956649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c057-2678-4e39-8e9d-1607320c0328 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:57.957023 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c057-2678-4e39-8e9d-1607320c0328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:57.957119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:57.985916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2185c057-2678-4e39-8e9d-1607320c0328 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:57.987349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2185c057-2678-4e39-8e9d-1607320c0328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:58.023188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:58.083269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 931/1874] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:29:58.100704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.106027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:58.156867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 944/1875] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:58.160964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185c057-2678-4e39-8e9d-1607320c0328 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.170802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185c057-2678-4e39-8e9d-1607320c0328 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.176811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.177497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.177857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.178288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.179003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:29:58.179376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.181265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.196421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 945/1876] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:29:58.201383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f4673-1b4f-4b35-9491-7499cfc22b38 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.202851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.205268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fb6adedea24758bd852be1702cd1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.205958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.206333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.206670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.212714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acc121-4582-47c1-b98b-7d07dd704a38 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.216936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.217355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.218373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.218548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.218741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.218890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.219374 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.221441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.229490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 932/1877] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:58.255831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 946/1878] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:29:58 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:58.258182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.269797 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43761a4a-a60f-4243-ab7c-9e045a246930 service glance] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.339995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.340989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.341453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.341900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.343017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.346441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.374219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 933/1879] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:29:58 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:29:58.378233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.390193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205c17e-0318-443e-8fb6-9b57a41cd614 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.395675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.396389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.396762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.397098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.397807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.399511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.411123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 947/1880] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:29:58.415092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.425452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fe21e-d2ec-466d-872d-201d41a15bfe admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.430213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec46d44-9f48-4cab-b0fd-d6d0ed409109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.430815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec46d44-9f48-4cab-b0fd-d6d0ed409109 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.431096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec46d44-9f48-4cab-b0fd-d6d0ed409109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.431373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec46d44-9f48-4cab-b0fd-d6d0ed409109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.432045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec46d44-9f48-4cab-b0fd-d6d0ed409109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.433629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec46d44-9f48-4cab-b0fd-d6d0ed409109 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.448193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 934/1881] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:29:58.451099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.461534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bd9ee-8d94-44e1-8f71-67d9cfcfce87 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.466305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.466954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.467231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.467498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] PATH_INFO: `/v3/projects/b5e74fd8e66643109e9487d1b71e91c1/users/909a8fb02bf8468a9914e78b23c8ea42/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.484177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e74fd8e66643109e9487d1b71e91c1, user_id=909a8fb02bf8468a9914e78b23c8ea42, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.486714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.502584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 948/1882] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:29:58 2022] PUT /identity/v3/projects/b5e74fd8e66643109e9487d1b71e91c1/users/909a8fb02bf8468a9914e78b23c8ea42/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:29:58.507262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.507730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.508101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.535206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:29:58.536612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:58.579216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:29:58.611896 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 935/1883] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:29:58.620467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:58.622773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:29:58.693659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1297e3-2761-450d-a85d-6c5a6dff9dc8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:29:58.708303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d942fd-210b-4d7a-927c-256c5da4be2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:29:58.709585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d942fd-210b-4d7a-927c-256c5da4be2a service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:29:58.710052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d942fd-210b-4d7a-927c-256c5da4be2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:29:58.710880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d942fd-210b-4d7a-927c-256c5da4be2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:29:58.730504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d942fd-210b-4d7a-927c-256c5da4be2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:29:58.736623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d942fd-210b-4d7a-927c-256c5da4be2a service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:29:58.751813 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 949/1884] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:29:59.991616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:29:59.994846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:00.007002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3e68b-34b3-47fe-9d47-a12f982f513e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:00.020453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:00.021347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:00.022033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:00.022968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] PATH_INFO: `/v3/users/3cd83d3b7c0b42bcba39432245512367` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:00.024357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd83d3b7c0b42bcba39432245512367)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:00.027566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:00.106159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd83d3b7c0b42bcba39432245512367'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.108075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd83d3b7c0b42bcba39432245512367'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.125673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd83d3b7c0b42bcba39432245512367'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.126983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd83d3b7c0b42bcba39432245512367'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.145938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd83d3b7c0b42bcba39432245512367'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.172462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 936/1885] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:29:59 2022] DELETE /identity/v3/users/3cd83d3b7c0b42bcba39432245512367 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:00.176949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:00.177756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:00.178173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:00.203310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:00.205085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:00.233849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:00.290564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 950/1886] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:00.303913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:00.306456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:00.412409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34374a-7d9a-4ca0-9d07-0ea07ae9a61f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:00.426067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e447200-8c92-44f0-b259-5593827d9756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:00.426954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447200-8c92-44f0-b259-5593827d9756 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:00.428004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447200-8c92-44f0-b259-5593827d9756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:00.428381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447200-8c92-44f0-b259-5593827d9756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:00.440235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e447200-8c92-44f0-b259-5593827d9756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:00.442023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e447200-8c92-44f0-b259-5593827d9756 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:00.457178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 937/1887] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:00.729311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:00.733891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:00.771169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425c591-cc9d-43df-82e3-9d777354eacb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:00.783483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:00.784533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:00.784819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:00.785138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] PATH_INFO: `/v3/users/693a44fb549d435eaae8d9372f92c223` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:00.786443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693a44fb549d435eaae8d9372f92c223)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:00.788817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:00.897049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693a44fb549d435eaae8d9372f92c223'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.898300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693a44fb549d435eaae8d9372f92c223'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.928646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693a44fb549d435eaae8d9372f92c223'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.931650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693a44fb549d435eaae8d9372f92c223'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.948283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693a44fb549d435eaae8d9372f92c223'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:00.997102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 951/1888] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:30:00 2022] DELETE /identity/v3/users/693a44fb549d435eaae8d9372f92c223 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:01.001710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.002275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.002377 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.038912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:01.046679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:01.137321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:01.164527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:01.166029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:01.194445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 938/1889] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:30:01.200983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:01.202760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:01.301204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d1dee-a22a-4d0a-b4d4-918ab0f73a61 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:01.307121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:01.307868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.308126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.308407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] PATH_INFO: `/v3/projects/be434511df4246618777d7b2efce3130` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.310659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be434511df4246618777d7b2efce3130)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:01.312631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:01.313523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca21f-1670-4b05-9b05-86566d943241 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:01.317682 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598a36a-f89a-441e-8960-0003e13a8ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:01.319990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598a36a-f89a-441e-8960-0003e13a8ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.319990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598a36a-f89a-441e-8960-0003e13a8ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.319990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598a36a-f89a-441e-8960-0003e13a8ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.330007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598a36a-f89a-441e-8960-0003e13a8ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:01.331485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598a36a-f89a-441e-8960-0003e13a8ea8 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:01.343327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 939/1890] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:01.363443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:01.377841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be434511df4246618777d7b2efce3130', 'request_id': 'req-7848ea6e-b93c-466c-afaf-ef112f2951f1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:01.385140 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be434511df4246618777d7b2efce3130', 'request_id': 'req-7848ea6e-b93c-466c-afaf-ef112f2951f1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:01.393905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be434511df4246618777d7b2efce3130', 'request_id': 'req-7848ea6e-b93c-466c-afaf-ef112f2951f1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:01.417982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] The token cache is being invalidate because project be434511df4246618777d7b2efce3130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:30:01.419037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:01.420560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7848ea6e-b93c-466c-afaf-ef112f2951f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:01.422660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 952/1891] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:30:01 2022] DELETE /identity/v3/projects/be434511df4246618777d7b2efce3130 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:30:01.428374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45a3f-e5b3-4ff8-a7be-f52ec139790c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.428954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45a3f-e5b3-4ff8-a7be-f52ec139790c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.430127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45a3f-e5b3-4ff8-a7be-f52ec139790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.458191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9fa45a3f-e5b3-4ff8-a7be-f52ec139790c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:01.460351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9fa45a3f-e5b3-4ff8-a7be-f52ec139790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:01.579414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 940/1892] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:01.581188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b97e7-1b0e-4ed8-862a-4c4b15eabd51 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.581479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b97e7-1b0e-4ed8-862a-4c4b15eabd51 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.581806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b97e7-1b0e-4ed8-862a-4c4b15eabd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.631464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2d4b97e7-1b0e-4ed8-862a-4c4b15eabd51 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:01.632970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d4b97e7-1b0e-4ed8-862a-4c4b15eabd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:01.653185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 953/1893] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:01.654918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45a3f-e5b3-4ff8-a7be-f52ec139790c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:01.672075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45a3f-e5b3-4ff8-a7be-f52ec139790c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:01.688258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:01.688954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.689242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.689603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.690447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:30:01.691273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:01.693385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:01.712142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 941/1894] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:30:01.713982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b97e7-1b0e-4ed8-862a-4c4b15eabd51 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:01.749464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b97e7-1b0e-4ed8-862a-4c4b15eabd51 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:01.756742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:01.757627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.758036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.758413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.759192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:01.762129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:01.768682 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:01.769509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:01.797153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1559f2-2e52-4aaa-9f91-826c9ff7af56 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:01.836599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:01.840070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:01.841713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:01.842075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] PATH_INFO: `/v3/projects/7cca354a27664ecf8812ff8c8c202dae` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:01.844990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cca354a27664ecf8812ff8c8c202dae)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:01.848868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:01.852938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 954/1895] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:01 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:30:01.854727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:01.962996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b93a-a684-4638-ba83-b7899e3f7b69 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:01.991109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cca354a27664ecf8812ff8c8c202dae', 'request_id': 'req-270a0a70-628c-4a6e-ae35-ff37d122aca9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.006842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cca354a27664ecf8812ff8c8c202dae', 'request_id': 'req-270a0a70-628c-4a6e-ae35-ff37d122aca9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.024192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cca354a27664ecf8812ff8c8c202dae', 'request_id': 'req-270a0a70-628c-4a6e-ae35-ff37d122aca9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.049702 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] The token cache is being invalidate because project 7cca354a27664ecf8812ff8c8c202dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:30:02.050382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.050940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.054040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 942/1896] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:30:01 2022] DELETE /identity/v3/projects/7cca354a27664ecf8812ff8c8c202dae => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:02.059347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.063242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.080056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9babb-6712-473c-9b6c-a0a1d1e5b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.080056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9babb-6712-473c-9b6c-a0a1d1e5b9ea admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.080056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9babb-6712-473c-9b6c-a0a1d1e5b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.080056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9babb-6712-473c-9b6c-a0a1d1e5b9ea admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.080503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9babb-6712-473c-9b6c-a0a1d1e5b9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.081125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:02.085920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9babb-6712-473c-9b6c-a0a1d1e5b9ea admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.143096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 955/1897] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:01 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:02.145117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.145117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.145496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.169710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:02.171139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.185230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 956/1898] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:02.186420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.188346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.202245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a0a70-628c-4a6e-ae35-ff37d122aca9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.211562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1ae9f-198c-4d55-9c83-702cf68d4e33 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.213446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.214112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.214394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.214667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] PATH_INFO: `/v3/users/c261c3cd605d4d9fbb17e7cd163b5217` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.216040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c261c3cd605d4d9fbb17e7cd163b5217)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.218181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.218772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437042b6-5427-4ff2-ab46-6b13ddc15c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.219615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437042b6-5427-4ff2-ab46-6b13ddc15c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.220121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437042b6-5427-4ff2-ab46-6b13ddc15c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.220628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437042b6-5427-4ff2-ab46-6b13ddc15c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.221802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437042b6-5427-4ff2-ab46-6b13ddc15c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.223602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437042b6-5427-4ff2-ab46-6b13ddc15c77 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.241854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 957/1899] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:02.244197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e769b-4de4-4f33-8eb2-0963f7a452bd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.245581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e769b-4de4-4f33-8eb2-0963f7a452bd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.246080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e769b-4de4-4f33-8eb2-0963f7a452bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.293146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8f0e769b-4de4-4f33-8eb2-0963f7a452bd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:02.294623 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8f0e769b-4de4-4f33-8eb2-0963f7a452bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.308323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c261c3cd605d4d9fbb17e7cd163b5217'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.308786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 958/1900] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:02.309246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c261c3cd605d4d9fbb17e7cd163b5217'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.311010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e769b-4de4-4f33-8eb2-0963f7a452bd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.321188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c261c3cd605d4d9fbb17e7cd163b5217'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.321836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c261c3cd605d4d9fbb17e7cd163b5217'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.327291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e769b-4de4-4f33-8eb2-0963f7a452bd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.333126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.333795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.334232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.334512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.335299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.337075 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.358791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:02.358791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 959/1901] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:02.359368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c261c3cd605d4d9fbb17e7cd163b5217'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:02.361773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.366216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.377658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 943/1902] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:30:02 2022] DELETE /identity/v3/users/c261c3cd605d4d9fbb17e7cd163b5217 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:02.378686 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.380742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.387300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be30223-8a8d-4dee-b11e-6255067034da admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.470880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbe211-9a12-4dfc-a6ac-34296c60b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.472047 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe211-9a12-4dfc-a6ac-34296c60b744 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.472329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe211-9a12-4dfc-a6ac-34296c60b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.472787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe211-9a12-4dfc-a6ac-34296c60b744 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.473450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbe211-9a12-4dfc-a6ac-34296c60b744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:30:02.473972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbe211-9a12-4dfc-a6ac-34296c60b744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.475967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbe211-9a12-4dfc-a6ac-34296c60b744 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.502645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee175d25-dd18-4155-ad18-ca2fc7c03bb2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.506547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 960/1903] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:30:02.507961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d83b-363c-4f33-b1db-7889c2c45a31 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.508250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d83b-363c-4f33-b1db-7889c2c45a31 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.508531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142d83b-363c-4f33-b1db-7889c2c45a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.511990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8572c0-3d21-4cfb-9a56-86cb1b1d55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.512782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8572c0-3d21-4cfb-9a56-86cb1b1d55f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.513075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8572c0-3d21-4cfb-9a56-86cb1b1d55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.513352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8572c0-3d21-4cfb-9a56-86cb1b1d55f4 admin admin] PATH_INFO: `/v3/projects/00932be8bff24f37a155f523154f930a/users/eb24425427174fc7b6da943abc25a419/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.544624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8572c0-3d21-4cfb-9a56-86cb1b1d55f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00932be8bff24f37a155f523154f930a, user_id=eb24425427174fc7b6da943abc25a419, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.547908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8572c0-3d21-4cfb-9a56-86cb1b1d55f4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.553315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9142d83b-363c-4f33-b1db-7889c2c45a31 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:02.554500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9142d83b-363c-4f33-b1db-7889c2c45a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.571301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 961/1904] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:02.572340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 944/1905] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:02 2022] PUT /identity/v3/projects/00932be8bff24f37a155f523154f930a/users/eb24425427174fc7b6da943abc25a419/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:02.572481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142d83b-363c-4f33-b1db-7889c2c45a31 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.577711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.578166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.578598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.585971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142d83b-363c-4f33-b1db-7889c2c45a31 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.605762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:02.608959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.617918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:02.669861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.671546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.671976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.672352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.673108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.675834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.692338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 945/1906] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:30:02.693455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.701205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.720260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 962/1907] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:02 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:02.720260 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.722507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:02.778939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714efe62-1ed4-487e-b818-b0382b85314f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.829188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1811a-0b8b-4839-be43-75e60389c697 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:02.836195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.836963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.837349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.837693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.848658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:02.849280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:02.849564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:02.849843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:02.894866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:02.954352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.957154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.970575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:02.973416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 946/1908] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:02.974289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:02.984715 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:02.989356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a026c07-e1bf-4f2d-9a37-5a7a78bc31a7 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:03.006864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:03.008099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:03.008383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:03.014887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:03.018247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 963/1909] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:03.018943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:03.021305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:03.044370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:03.054960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 947/1910] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:02 2022] POST /identity/v3/users => generated 285 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:03.055781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:03.068286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0a60-821a-4b47-b6ad-6bc157717319 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:03.075106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:03.076597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:03.076962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:03.077243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:03.078155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:03.081852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:03.143218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 964/1911] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:30:03.147268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:03.186197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3997-ad04-461d-a1c5-ffda92301e1d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:03.210936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085f4a5-f0b8-4ca6-a039-ab7fcb236cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:03.210936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f4a5-f0b8-4ca6-a039-ab7fcb236cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:03.214732 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f4a5-f0b8-4ca6-a039-ab7fcb236cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:03.215018 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f4a5-f0b8-4ca6-a039-ab7fcb236cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:03.215746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f4a5-f0b8-4ca6-a039-ab7fcb236cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:03.225936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f4a5-f0b8-4ca6-a039-ab7fcb236cd1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:03.258063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 948/1912] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:03.258697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:03.287045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39359859-b68e-4c74-8758-7a759e113a37 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:03.293472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:03.294790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:03.295176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:03.295592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] PATH_INFO: `/v3/projects/4d37a219659b482e874cd6d5c0384461/users/0934e658da474331a8a16d07d465cfcd/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:03.317718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d37a219659b482e874cd6d5c0384461, user_id=0934e658da474331a8a16d07d465cfcd, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:03.323341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:03.358908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 965/1913] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:03 2022] PUT /identity/v3/projects/4d37a219659b482e874cd6d5c0384461/users/0934e658da474331a8a16d07d465cfcd/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:30:03.364097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:03.364399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:03.365806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:03.386547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:03.389670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:03.473366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 949/1914] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:03.490081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:03.621998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d12a6-b8af-4abb-8e85-84aaf2ec0f0b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:03.636059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:03.636910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:03.637244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:03.637526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:03.668519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:03.670033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:03.683253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 966/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:03.846922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:03.848595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:03.873184 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dc58-39a2-49bb-a6fe-e950bd6afd03 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:03.882642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:03.885572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:03.885860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:03.887349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] PATH_INFO: `/v3/projects/4872ac2266174e1985ff082169ad8205` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:03.888898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4872ac2266174e1985ff082169ad8205)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:03.894188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:04.001253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4872ac2266174e1985ff082169ad8205', 'request_id': 'req-8f37e558-f486-4ce0-8713-138c60495d9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.016157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4872ac2266174e1985ff082169ad8205', 'request_id': 'req-8f37e558-f486-4ce0-8713-138c60495d9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.035058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4872ac2266174e1985ff082169ad8205', 'request_id': 'req-8f37e558-f486-4ce0-8713-138c60495d9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.069700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] The token cache is being invalidate because project 4872ac2266174e1985ff082169ad8205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:30:04.070002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.070688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8f37e558-f486-4ce0-8713-138c60495d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.072889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 950/1916] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:30:03 2022] DELETE /identity/v3/projects/4872ac2266174e1985ff082169ad8205 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:04.078157 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:04.090889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e055a5-fdb8-4b6d-bc61-e9939afa146f service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:04.254771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:04.255628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:04.256117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:04.256541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] PATH_INFO: `/v3/users/8ddd90faf56a4564a4ffc99419597fc4` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:04.258823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddd90faf56a4564a4ffc99419597fc4)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:04.261720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:04.325618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:04.362309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddd90faf56a4564a4ffc99419597fc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.367537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddd90faf56a4564a4ffc99419597fc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.407784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddd90faf56a4564a4ffc99419597fc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.408560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddd90faf56a4564a4ffc99419597fc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.417905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddd90faf56a4564a4ffc99419597fc4'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:04.433846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 967/1917] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:30:04 2022] DELETE /identity/v3/users/8ddd90faf56a4564a4ffc99419597fc4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:04.656193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34570b-6072-405e-a836-703714d193af None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:04.656577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34570b-6072-405e-a836-703714d193af None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:04.656737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34570b-6072-405e-a836-703714d193af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:04.688455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2f34570b-6072-405e-a836-703714d193af None None] MFA Rules not processed for user `c0dd49c1b3b242558a40b6e798e952f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:04.690336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2f34570b-6072-405e-a836-703714d193af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:04.786059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 951/1918] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:05.604584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:05.606346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:05.734672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9eaf9-9907-4730-98b0-eb9be6e37a1d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:05.739586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:05.740762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:05.740762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:05.740976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] PATH_INFO: `/v3/projects/1c893c65ff334fdb81684b3b66cdd4e2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:05.749353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c893c65ff334fdb81684b3b66cdd4e2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:05.751425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:05.867065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c893c65ff334fdb81684b3b66cdd4e2', 'request_id': 'req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:05.876548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c893c65ff334fdb81684b3b66cdd4e2', 'request_id': 'req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:05.887426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c893c65ff334fdb81684b3b66cdd4e2', 'request_id': 'req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:05.913287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] The token cache is being invalidate because project 1c893c65ff334fdb81684b3b66cdd4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:30:05.914873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:05.915221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2ec2da1f-4b4a-4162-bb42-340b7e4e15e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:05.917229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 968/1919] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:30:05 2022] DELETE /identity/v3/projects/1c893c65ff334fdb81684b3b66cdd4e2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:05.921958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a2f8-6934-41db-a64f-11745f7b0d4b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:05.922371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a2f8-6934-41db-a64f-11745f7b0d4b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:05.922542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a2f8-6934-41db-a64f-11745f7b0d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:05.955438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e420a2f8-6934-41db-a64f-11745f7b0d4b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:05.958104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e420a2f8-6934-41db-a64f-11745f7b0d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:05.997763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:06.124626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 952/1920] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:06.134579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91aeb7-11a7-439a-869f-81a08b51398a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.135024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91aeb7-11a7-439a-869f-81a08b51398a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.136214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91aeb7-11a7-439a-869f-81a08b51398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:06.168703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1e91aeb7-11a7-439a-869f-81a08b51398a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:06.170096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1e91aeb7-11a7-439a-869f-81a08b51398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:06.186051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 969/1921] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:06.190412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420a2f8-6934-41db-a64f-11745f7b0d4b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:06.208481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420a2f8-6934-41db-a64f-11745f7b0d4b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:06.219308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:06.222474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.222957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.223678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:06.224679 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:30:06.225287 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:06.228347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:06.247163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 953/1922] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:30:06.251328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91aeb7-11a7-439a-869f-81a08b51398a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:06.267920 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91aeb7-11a7-439a-869f-81a08b51398a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:06.278573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:06.280167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.280167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.280167 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:06.280939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:06.282978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:06.371896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 970/1923] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:06 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:06.375199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:06.419783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570e731-3767-484a-8df8-04a29472ac9e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:06.612395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:06.615246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.617008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.617562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:06.618494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:06.621178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:06.667372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 954/1924] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:06 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:06.669761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:06.680511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671569-00cb-467b-b2f0-7afee1b1c1b2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:06.685685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:06.686323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.686604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.686882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:06.687538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:06.689187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:06.693396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:06.705055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 971/1925] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:06.706951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:06.723731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fffea-2d9f-44ea-9af2-525dca70c0e0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:06.739784 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412b1d-2c62-4adb-aed7-ea817600303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:06.740454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412b1d-2c62-4adb-aed7-ea817600303f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.740739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412b1d-2c62-4adb-aed7-ea817600303f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.741014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412b1d-2c62-4adb-aed7-ea817600303f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:06.741705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412b1d-2c62-4adb-aed7-ea817600303f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:06.743348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412b1d-2c62-4adb-aed7-ea817600303f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:06.783210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 955/1926] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:30:06.788098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:06.804505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdc76-bdab-4583-b71c-5237277e5402 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:06.838020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:06.839884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.839884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.839884 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] PATH_INFO: `/v3/projects/71bccd6b96b84f5893ffbe91343fc878/users/af309000477d4209890177639b3c2103/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:06.930569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bccd6b96b84f5893ffbe91343fc878, user_id=af309000477d4209890177639b3c2103, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:06.940451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:06.985002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 972/1927] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:06 2022] PUT /identity/v3/projects/71bccd6b96b84f5893ffbe91343fc878/users/af309000477d4209890177639b3c2103/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:06.990259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f4596-a6c3-41e1-bfc2-e165f20a2b5d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:06.990814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f4596-a6c3-41e1-bfc2-e165f20a2b5d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:06.991108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f4596-a6c3-41e1-bfc2-e165f20a2b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:07.039500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-205f4596-a6c3-41e1-bfc2-e165f20a2b5d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:07.040848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-205f4596-a6c3-41e1-bfc2-e165f20a2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:07.281263 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 956/1928] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:07.484604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:07.486382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:07.733817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b034f-77d4-45e5-856f-ac2fcf7619ca admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:07.753124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c2df-c216-4ad1-bc7f-02b25278a28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:07.759301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c2df-c216-4ad1-bc7f-02b25278a28e service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:07.759890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c2df-c216-4ad1-bc7f-02b25278a28e service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:07.760690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c2df-c216-4ad1-bc7f-02b25278a28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:07.812069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c2df-c216-4ad1-bc7f-02b25278a28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:07.812069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c2df-c216-4ad1-bc7f-02b25278a28e service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:07.845302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:07.845745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:07.846112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:07.878298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 973/1929] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:07.916447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] MFA Rules not processed for user `909a8fb02bf8468a9914e78b23c8ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:07.918316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:07.946346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:08.075911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 957/1930] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:30:08.084876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951cb81-9d49-4163-bb8c-1f198107936f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:08.085775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951cb81-9d49-4163-bb8c-1f198107936f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:08.085775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951cb81-9d49-4163-bb8c-1f198107936f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:08.127568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9951cb81-9d49-4163-bb8c-1f198107936f None None] MFA Rules not processed for user `909a8fb02bf8468a9914e78b23c8ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:08.130277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9951cb81-9d49-4163-bb8c-1f198107936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:08.153427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 974/1931] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:08.166357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:08.177951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:08.339941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edff6f-18db-4147-bf2c-7db5dd403e16 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:08.357555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9437f-4322-40e7-a4c2-90f4a1c82613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:08.358105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9437f-4322-40e7-a4c2-90f4a1c82613 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:08.358428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9437f-4322-40e7-a4c2-90f4a1c82613 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:08.358710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9437f-4322-40e7-a4c2-90f4a1c82613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:08.379065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9437f-4322-40e7-a4c2-90f4a1c82613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:08.380734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9437f-4322-40e7-a4c2-90f4a1c82613 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:08.433262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 958/1932] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:11.315774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1924e3d-aa1f-4d55-bba4-4a3bd4d28389 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:11.316737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1924e3d-aa1f-4d55-bba4-4a3bd4d28389 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:11.317168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1924e3d-aa1f-4d55-bba4-4a3bd4d28389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:11.342706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a1924e3d-aa1f-4d55-bba4-4a3bd4d28389 None None] MFA Rules not processed for user `909a8fb02bf8468a9914e78b23c8ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:11.344235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a1924e3d-aa1f-4d55-bba4-4a3bd4d28389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:11.367995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 975/1933] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:11.642709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a99c-9060-440b-9cf5-48146a0024c2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:11.643626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a99c-9060-440b-9cf5-48146a0024c2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:11.644137 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a99c-9060-440b-9cf5-48146a0024c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:11.750286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1a72a99c-9060-440b-9cf5-48146a0024c2 None None] MFA Rules not processed for user `af309000477d4209890177639b3c2103`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:11.756539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1a72a99c-9060-440b-9cf5-48146a0024c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:11.920234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 959/1934] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:11.925408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1924e3d-aa1f-4d55-bba4-4a3bd4d28389 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:11.939386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1924e3d-aa1f-4d55-bba4-4a3bd4d28389 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:11.959342 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:11.962243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:11.962592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:11.962917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:11.963526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:11.965755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:12.019991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 976/1935] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:11 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:30:12.024783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72a99c-9060-440b-9cf5-48146a0024c2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:12.098054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72a99c-9060-440b-9cf5-48146a0024c2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:12.162070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:12.239033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:12.239670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:12.240124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:12.240395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:12.241038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:12.251026 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:12.285036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 960/1936] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:12 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:12.287043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:12.303006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748beb-42ba-4676-8ab3-fd64472570ab admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:12.322743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:12.324755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:12.325249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:12.325699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:12.328020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:12.332466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:12.362596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 977/1937] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:12.363261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:12.374334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ceda5-e46f-44a9-ae2d-07bb470048ea admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:12.402957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:12.403901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:12.404416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:12.404762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] PATH_INFO: `/v3/projects/4a187302d98d483eb9edfdd2ebc8c003/users/9faec55668c14b169085968f7a9c54eb/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:12.430409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a187302d98d483eb9edfdd2ebc8c003, user_id=9faec55668c14b169085968f7a9c54eb, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:12.433438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:12.454449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 961/1938] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:12 2022] PUT /identity/v3/projects/4a187302d98d483eb9edfdd2ebc8c003/users/9faec55668c14b169085968f7a9c54eb/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:12.458283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:12.478247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425faba-794d-442e-ad01-38eabd6d70d9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:12.671531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9ccd0-6923-40b9-8d52-87df738eb004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:12.672462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ccd0-6923-40b9-8d52-87df738eb004 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:12.672957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ccd0-6923-40b9-8d52-87df738eb004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:12.673570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ccd0-6923-40b9-8d52-87df738eb004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:12.674594 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9ccd0-6923-40b9-8d52-87df738eb004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:12.679944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9ccd0-6923-40b9-8d52-87df738eb004 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:12.715310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:12.721022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 978/1939] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:12.736070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f31a4-76af-417e-a256-ecdee1dca8a0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:12.776746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:12.777357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:12.777640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:12.781376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] PATH_INFO: `/v3/projects/4a187302d98d483eb9edfdd2ebc8c003/users/9faec55668c14b169085968f7a9c54eb/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:12.795596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a187302d98d483eb9edfdd2ebc8c003, user_id=9faec55668c14b169085968f7a9c54eb, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:12.822894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:12.877986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 962/1940] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:12 2022] PUT /identity/v3/projects/4a187302d98d483eb9edfdd2ebc8c003/users/9faec55668c14b169085968f7a9c54eb/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:15.968504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132fdc4-067c-4e43-b0e5-7280e547dc3c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:15.970297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132fdc4-067c-4e43-b0e5-7280e547dc3c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:15.970569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132fdc4-067c-4e43-b0e5-7280e547dc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:16.015420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6132fdc4-067c-4e43-b0e5-7280e547dc3c None None] MFA Rules not processed for user `0934e658da474331a8a16d07d465cfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:16.016877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6132fdc4-067c-4e43-b0e5-7280e547dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:16.035955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:16.112385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 979/1941] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:16.118626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:16.123533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:16.259449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5793-1898-42fa-b449-208f4cb1dde6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:16.268500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:16.270761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:16.271134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:16.271526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:16.272308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:16.276319 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:16.350254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 963/1942] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:16 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:30:16.354539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132fdc4-067c-4e43-b0e5-7280e547dc3c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:16.368176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132fdc4-067c-4e43-b0e5-7280e547dc3c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:16.495069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:16.495728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:16.498079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:16.498543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:16.499392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:16.501552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:16.556529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 980/1943] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:16 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:30:16.561566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:16.587361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027ad8a-021a-456b-a14c-e023832a1bf4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:16.602481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:16.604955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:16.605291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:16.605832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:16.606829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:16.609053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:16.649456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 964/1944] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:16.653772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:16.678336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb557163-66cd-404d-9944-dfcfd58a5fea admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:16.706696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:16.707399 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:16.707689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:16.708037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] PATH_INFO: `/v3/projects/b4d88e64058e4273a11b86902ea82214/users/b2cd25fa1da441be904ddf703ecdfd5b/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:16.748158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d88e64058e4273a11b86902ea82214, user_id=b2cd25fa1da441be904ddf703ecdfd5b, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:16.751606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:16.788639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 981/1945] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:16 2022] PUT /identity/v3/projects/b4d88e64058e4273a11b86902ea82214/users/b2cd25fa1da441be904ddf703ecdfd5b/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:16.789835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:16.807874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383538-a276-41e3-b482-c0415dbd0bf1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:16.909193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:16.922634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192dfb1-265b-4d17-a4d2-a01dbe1bdfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:16.923143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192dfb1-265b-4d17-a4d2-a01dbe1bdfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:16.924675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192dfb1-265b-4d17-a4d2-a01dbe1bdfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:16.925296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192dfb1-265b-4d17-a4d2-a01dbe1bdfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:16.926573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192dfb1-265b-4d17-a4d2-a01dbe1bdfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:16.928422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192dfb1-265b-4d17-a4d2-a01dbe1bdfa6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:16.939462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 965/1946] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:16.944309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:16.955686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc01df-c532-4d4f-9513-e72a61b63b47 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:16.962684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4310ab-289e-4164-8bc2-c3e39d76e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:16.963503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4310ab-289e-4164-8bc2-c3e39d76e547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:16.964117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4310ab-289e-4164-8bc2-c3e39d76e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:16.964401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4310ab-289e-4164-8bc2-c3e39d76e547 admin admin] PATH_INFO: `/v3/projects/b4d88e64058e4273a11b86902ea82214/users/b2cd25fa1da441be904ddf703ecdfd5b/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:16.966401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4310ab-289e-4164-8bc2-c3e39d76e547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d88e64058e4273a11b86902ea82214, user_id=b2cd25fa1da441be904ddf703ecdfd5b, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:16.969093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4310ab-289e-4164-8bc2-c3e39d76e547 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:16.983033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 982/1947] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:16 2022] PUT /identity/v3/projects/b4d88e64058e4273a11b86902ea82214/users/b2cd25fa1da441be904ddf703ecdfd5b/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:18.383938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a22344-1b6d-40dd-b1c7-5a37ec2acdcc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:18.384492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a22344-1b6d-40dd-b1c7-5a37ec2acdcc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:18.384655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a22344-1b6d-40dd-b1c7-5a37ec2acdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:18.466283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c6a22344-1b6d-40dd-b1c7-5a37ec2acdcc None None] MFA Rules not processed for user `9faec55668c14b169085968f7a9c54eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:18.470387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c6a22344-1b6d-40dd-b1c7-5a37ec2acdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:18.605302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 966/1948] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:18.616641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d8839-138b-4ee0-be0e-3ce2e30c4d10 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:18.617364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d8839-138b-4ee0-be0e-3ce2e30c4d10 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:18.617463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d8839-138b-4ee0-be0e-3ce2e30c4d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:18.647267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fc6d8839-138b-4ee0-be0e-3ce2e30c4d10 None None] MFA Rules not processed for user `af309000477d4209890177639b3c2103`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:18.649784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fc6d8839-138b-4ee0-be0e-3ce2e30c4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:18.811545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 983/1949] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:18.818619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a22344-1b6d-40dd-b1c7-5a37ec2acdcc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:18.959400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a22344-1b6d-40dd-b1c7-5a37ec2acdcc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:18.978510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:18.979443 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:18.979935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:18.980372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:19.005357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:19.007286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:19.025272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 967/1950] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:30:19.874332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a4a2a-4152-4313-8972-421fd9a8561b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:19.875481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a4a2a-4152-4313-8972-421fd9a8561b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:19.877795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a4a2a-4152-4313-8972-421fd9a8561b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:19.928581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:19.936636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-105a4a2a-4152-4313-8972-421fd9a8561b None None] MFA Rules not processed for user `eb24425427174fc7b6da943abc25a419`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:19.941407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-105a4a2a-4152-4313-8972-421fd9a8561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:20.067765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 984/1951] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:20.069031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:20.071423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:20.221465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41b57b-9a7c-4992-944a-89da6670d43f service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:20.229170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:20.229897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:20.230191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:20.230437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:20.231476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:20.238734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:20.251301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:20.313628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 968/1952] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:20 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:30:20.314840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a4a2a-4152-4313-8972-421fd9a8561b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:20.332461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a4a2a-4152-4313-8972-421fd9a8561b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:20.415507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:20.416519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:20.416907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:20.418661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:20.419422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:20.421852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:20.458969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 985/1953] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:20 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:20.460288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:20.471423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1fb32-5327-45fe-8b96-2ffa1a932242 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:20.477201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:20.478456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:20.479232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:20.479525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:20.480238 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:20.481862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:20.494701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 969/1954] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:20.498831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:20.510639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f714bb-dd41-4ce0-b32e-546529c76821 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:20.515941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:20.517257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:20.517642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:20.518014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] PATH_INFO: `/v3/projects/197aeee1fe9d4c82a6f93c57f7fa1cf7/users/fac420361f3c42dfabd078f13716d690/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:20.536612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=197aeee1fe9d4c82a6f93c57f7fa1cf7, user_id=fac420361f3c42dfabd078f13716d690, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:20.540052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:20.566301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 986/1955] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:20 2022] PUT /identity/v3/projects/197aeee1fe9d4c82a6f93c57f7fa1cf7/users/fac420361f3c42dfabd078f13716d690/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:20.570457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:20.586500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ddf2a-bf00-4578-b385-250f0d32b497 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:20.673188 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:20.674138 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:20.674540 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:20.674927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:20.675890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:20.677733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:20.695169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 970/1956] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:20.699072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:20.714862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2470-2c3a-46e8-b6ac-686c301bd89b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:20.726737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58707e1-815a-4e9f-9ef2-1a0651893dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:20.728011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58707e1-815a-4e9f-9ef2-1a0651893dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:20.728495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58707e1-815a-4e9f-9ef2-1a0651893dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:20.729152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58707e1-815a-4e9f-9ef2-1a0651893dda admin admin] PATH_INFO: `/v3/projects/197aeee1fe9d4c82a6f93c57f7fa1cf7/users/fac420361f3c42dfabd078f13716d690/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:20.732496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58707e1-815a-4e9f-9ef2-1a0651893dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=197aeee1fe9d4c82a6f93c57f7fa1cf7, user_id=fac420361f3c42dfabd078f13716d690, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:20.735433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58707e1-815a-4e9f-9ef2-1a0651893dda admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:20.798833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 987/1957] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:20 2022] PUT /identity/v3/projects/197aeee1fe9d4c82a6f93c57f7fa1cf7/users/fac420361f3c42dfabd078f13716d690/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:26.393809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:26.395990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:26.413526 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d1a90-ad7a-4e8e-9a71-9b320e70082c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:26.532006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:26.533077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:26.533655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:26.534123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] PATH_INFO: `/v3/users/6feb382cd176428c97874a7121e18ffb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:26.535771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6feb382cd176428c97874a7121e18ffb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:26.538736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:26.651978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6feb382cd176428c97874a7121e18ffb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:26.653284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6feb382cd176428c97874a7121e18ffb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:26.667683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6feb382cd176428c97874a7121e18ffb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:26.668441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6feb382cd176428c97874a7121e18ffb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:26.690886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6feb382cd176428c97874a7121e18ffb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:26.695300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:26.723911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 971/1958] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:30:26 2022] DELETE /identity/v3/users/6feb382cd176428c97874a7121e18ffb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:26.728828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:26.729320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:26.729320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:26.755298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:26.757351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:26.822606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:26.854604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 988/1959] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:30:26.870191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:26.873259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:27.037054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a27b6-d474-4f57-ba56-fb63b1149254 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:27.052257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf3cc0-f70b-4181-9b3a-46a1c48ecda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:27.053109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3cc0-f70b-4181-9b3a-46a1c48ecda6 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:27.053663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3cc0-f70b-4181-9b3a-46a1c48ecda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:27.054088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3cc0-f70b-4181-9b3a-46a1c48ecda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:27.101299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf3cc0-f70b-4181-9b3a-46a1c48ecda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:27.104543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf3cc0-f70b-4181-9b3a-46a1c48ecda6 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:27.122564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 972/1960] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:27.638603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:27.640358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:27.671291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49978b-c50a-4f6d-8696-e5ed1a7ea68f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:27.696622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:27.697553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:27.698013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:27.698440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] PATH_INFO: `/v3/projects/ee3a53fd2c8945449604c1aba0cf31cb` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:27.699907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3a53fd2c8945449604c1aba0cf31cb)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:27.702070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:27.795563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3a53fd2c8945449604c1aba0cf31cb', 'request_id': 'req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:27.805449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3a53fd2c8945449604c1aba0cf31cb', 'request_id': 'req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:27.820179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3a53fd2c8945449604c1aba0cf31cb', 'request_id': 'req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:27.848118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] The token cache is being invalidate because project ee3a53fd2c8945449604c1aba0cf31cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:30:27.849069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:27.850511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1fa6623a-2d0a-4364-a8e4-a0f1b3728f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:27.858058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 989/1961] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:30:27 2022] DELETE /identity/v3/projects/ee3a53fd2c8945449604c1aba0cf31cb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:27.861674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd57b-ab7c-4b63-9f0b-a81c0abd771d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:27.862128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd57b-ab7c-4b63-9f0b-a81c0abd771d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:27.862214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd57b-ab7c-4b63-9f0b-a81c0abd771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:27.884333 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f4dbd57b-ab7c-4b63-9f0b-a81c0abd771d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:27.887284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f4dbd57b-ab7c-4b63-9f0b-a81c0abd771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:27.976728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 973/1962] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:27.987452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0dc87-8629-4be4-ac1d-d3a37ec91748 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:27.987759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0dc87-8629-4be4-ac1d-d3a37ec91748 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:27.988067 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0dc87-8629-4be4-ac1d-d3a37ec91748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.019272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-45e0dc87-8629-4be4-ac1d-d3a37ec91748 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:28.020760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-45e0dc87-8629-4be4-ac1d-d3a37ec91748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:28.051775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 990/1963] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:28.057253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbd57b-ab7c-4b63-9f0b-a81c0abd771d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:28.075897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbd57b-ab7c-4b63-9f0b-a81c0abd771d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:28.082477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:28.083105 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.083385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.084307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.085693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:30:28.086003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:28.090082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:28.107832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 974/1964] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:30:28.111722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0dc87-8629-4be4-ac1d-d3a37ec91748 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:28.129203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0dc87-8629-4be4-ac1d-d3a37ec91748 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:28.145045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:28.146076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.146362 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.146642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.147310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:28.149696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:28.199483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 991/1965] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:28 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:28.203510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:28.220455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4333f-7db7-4573-9149-9eee43957bf0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:28.310516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:28.311059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.311343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.311617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.312328 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:28.314259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:28.356369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 975/1966] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:28 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:30:28.359461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:28.378204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8384-01e3-4946-b5f5-2cda4778650d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:28.391765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:28.393522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.393716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.393973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.394643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:28.397857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:28.415334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 992/1967] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:28.421327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:28.439474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b9bc6-09d1-4c5f-8bc5-7eb951e10c22 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:28.447817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a7c2-7313-4218-8508-793443143dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:28.448692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a7c2-7313-4218-8508-793443143dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.448972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a7c2-7313-4218-8508-793443143dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.449396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a7c2-7313-4218-8508-793443143dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.450425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a7c2-7313-4218-8508-793443143dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:28.452473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a7c2-7313-4218-8508-793443143dbf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:28.459881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:28.472714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 976/1968] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:28.473817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:28.489218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3d198-46dd-416d-896f-ccc1376a40e1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:28.500523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:28.506218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.506741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.507183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] PATH_INFO: `/v3/projects/96b57c85f2f646aea904fc1d5c1205d7/users/b6b68f3c19154263b3180f9eb6cf13ed/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.549836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b57c85f2f646aea904fc1d5c1205d7, user_id=b6b68f3c19154263b3180f9eb6cf13ed, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:28.552912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:28.573970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 993/1969] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:28 2022] PUT /identity/v3/projects/96b57c85f2f646aea904fc1d5c1205d7/users/b6b68f3c19154263b3180f9eb6cf13ed/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:30:28.585090 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657778fb-0b6b-430f-a2f7-776bb0739fb7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.585825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657778fb-0b6b-430f-a2f7-776bb0739fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.586484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657778fb-0b6b-430f-a2f7-776bb0739fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.631257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-657778fb-0b6b-430f-a2f7-776bb0739fb7 None None] MFA Rules not processed for user `b6b68f3c19154263b3180f9eb6cf13ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:28.634000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-657778fb-0b6b-430f-a2f7-776bb0739fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:28.723618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 977/1970] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:30:28.739688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:28.742714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:28.839452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e98cf-f320-46fd-ab3e-9ff17272f936 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:28.847428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fb6adedea24758bd852be1702cd1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:28.848247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:28.854137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:28.857603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:28.874061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:28.878042 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:28.914825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 994/1971] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:34.748000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d7b3-fff7-4aa3-af9a-47b4b42c82cd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:34.748535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d7b3-fff7-4aa3-af9a-47b4b42c82cd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:34.748734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d7b3-fff7-4aa3-af9a-47b4b42c82cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:34.863728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7885d7b3-fff7-4aa3-af9a-47b4b42c82cd None None] MFA Rules not processed for user `b2cd25fa1da441be904ddf703ecdfd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:34.865006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7885d7b3-fff7-4aa3-af9a-47b4b42c82cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:35.103658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 978/1972] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:35.332545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:35.339193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:35.430237 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:35.588861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6036-4133-4b1a-b743-867644481205 service glance] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:35.600069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:35.600784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:35.602289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:35.602782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:35.605578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:35.792501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:35.796822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:35.823205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 995/1973] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:37.455209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ac4d-f648-4940-95b5-f85cab1e586f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:37.455970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ac4d-f648-4940-95b5-f85cab1e586f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:37.456627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ac4d-f648-4940-95b5-f85cab1e586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:37.521175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4250ac4d-f648-4940-95b5-f85cab1e586f None None] MFA Rules not processed for user `fac420361f3c42dfabd078f13716d690`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:37.522563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4250ac4d-f648-4940-95b5-f85cab1e586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:37.667230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:37.676407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 979/1974] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:37.690125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:37.707337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7becda-11a5-4ba7-ac43-b88e65187a35 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:37.717649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fb6adedea24758bd852be1702cd1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:37.718849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:37.719340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:37.719873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:37.722307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:37.902016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:37.905456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:37.937398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 996/1975] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:38.235168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cb7e1-4f71-40c7-ae1d-c76088b79f6e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:38.235510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cb7e1-4f71-40c7-ae1d-c76088b79f6e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:38.235731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cb7e1-4f71-40c7-ae1d-c76088b79f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:38.276676 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-194cb7e1-4f71-40c7-ae1d-c76088b79f6e None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:38.280331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-194cb7e1-4f71-40c7-ae1d-c76088b79f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:38.477139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 980/1976] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:38.566781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:38.568470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:38.776298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:38.824886 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0051-2ae3-4823-a43b-c6836764208e service glance] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:38.836924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:38.839042 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:38.839552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:38.840051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:38.873010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:38.880331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:38.913798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 997/1977] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:30:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:30:41.150626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbb44f-a7c6-4ca0-9723-422ea32fb927 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:41.151108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbb44f-a7c6-4ca0-9723-422ea32fb927 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:41.151187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbb44f-a7c6-4ca0-9723-422ea32fb927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:41.189846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1dbbb44f-a7c6-4ca0-9723-422ea32fb927 None None] MFA Rules not processed for user `0934e658da474331a8a16d07d465cfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:41.192303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1dbbb44f-a7c6-4ca0-9723-422ea32fb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:41.215819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 981/1978] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:48.911294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=8 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:49.049765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:49.051675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:49.135036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73463a-8eaa-476c-bc16-75136c7c0bfc service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:49.146963 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:49.147997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:49.148496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:49.148985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:49.151856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:49.237021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:49.238498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:49.268025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 998/1979] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:51.177068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=28 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:54.006020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b816-e150-43dd-8684-8f137f7dfe7a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:54.006610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b816-e150-43dd-8684-8f137f7dfe7a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:54.006610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b816-e150-43dd-8684-8f137f7dfe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:54.031423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a5b3b816-e150-43dd-8684-8f137f7dfe7a None None] MFA Rules not processed for user `eb24425427174fc7b6da943abc25a419`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:54.032700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a5b3b816-e150-43dd-8684-8f137f7dfe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:54.040776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 982/1980] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:54.479363 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:54.557979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146784b-70e8-4049-9fdc-27bc58194bcb service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:54.562343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:54.562985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:54.563271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:54.563547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] PATH_INFO: `/v3/users/b6b68f3c19154263b3180f9eb6cf13ed` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:54.564733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b68f3c19154263b3180f9eb6cf13ed)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:54.567224 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:54.625965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b68f3c19154263b3180f9eb6cf13ed'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:54.626835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b68f3c19154263b3180f9eb6cf13ed'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:54.635055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:54.656296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b68f3c19154263b3180f9eb6cf13ed'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:54.657392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b68f3c19154263b3180f9eb6cf13ed'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:54.671151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e1d5d580-270c-4381-855f-ec09298e6f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b68f3c19154263b3180f9eb6cf13ed'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:54.711816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 999/1981] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:30:54 2022] DELETE /identity/v3/users/b6b68f3c19154263b3180f9eb6cf13ed => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:54.711967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:54.711967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:54.711967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:54.728241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:54.730823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:54.749865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:54.750396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:54.750740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:54.784615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:54.788222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:54.835768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 983/1982] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:54.845504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:54.847980 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:54.881775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1000/1983] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:30:54.897356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:54.898969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:54.923444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be975-f558-4be6-ae19-e922f311ece5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:54.927782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:54.928552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:54.928765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:54.929046 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:54.941771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:54.943477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:54.958530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 984/1984] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:30:54.991479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7486b-17e9-41f4-a6c3-1ca2818f6b40 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:54.997795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592228ce-2c37-4f7e-920a-7cfaa7546d50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:54.998568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592228ce-2c37-4f7e-920a-7cfaa7546d50 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:54.998857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592228ce-2c37-4f7e-920a-7cfaa7546d50 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:54.999316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592228ce-2c37-4f7e-920a-7cfaa7546d50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:55.010113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592228ce-2c37-4f7e-920a-7cfaa7546d50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:55.011896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592228ce-2c37-4f7e-920a-7cfaa7546d50 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:55.021646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1001/1985] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:30:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:30:55.355157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:55.358304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:55.401846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615f271-d651-4ee5-bec8-a677561a2aaa service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:55.457894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:55.458919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:55.459475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:55.459993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] PATH_INFO: `/v3/projects/96b57c85f2f646aea904fc1d5c1205d7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:55.462667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b57c85f2f646aea904fc1d5c1205d7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:55.465069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:55.566294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b57c85f2f646aea904fc1d5c1205d7', 'request_id': 'req-d1adeee6-e273-455b-acf4-4e8890adba22'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:55.578106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b57c85f2f646aea904fc1d5c1205d7', 'request_id': 'req-d1adeee6-e273-455b-acf4-4e8890adba22'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:55.587552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b57c85f2f646aea904fc1d5c1205d7', 'request_id': 'req-d1adeee6-e273-455b-acf4-4e8890adba22'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:55.611651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] The token cache is being invalidate because project 96b57c85f2f646aea904fc1d5c1205d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:30:55.613330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:55.615717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d1adeee6-e273-455b-acf4-4e8890adba22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:30:55.617750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 985/1986] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:30:55 2022] DELETE /identity/v3/projects/96b57c85f2f646aea904fc1d5c1205d7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:55.625215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2bd9c-10c7-4f68-b348-8a9b75b21d72 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:55.626041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2bd9c-10c7-4f68-b348-8a9b75b21d72 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:55.626041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2bd9c-10c7-4f68-b348-8a9b75b21d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:55.664858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-62f2bd9c-10c7-4f68-b348-8a9b75b21d72 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:55.664858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-62f2bd9c-10c7-4f68-b348-8a9b75b21d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:55.763509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1002/1987] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:55.764968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888dd8-1c5f-498e-ac86-5a38adba5db6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:55.765294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888dd8-1c5f-498e-ac86-5a38adba5db6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:55.765578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888dd8-1c5f-498e-ac86-5a38adba5db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:55.806297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-be888dd8-1c5f-498e-ac86-5a38adba5db6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:55.807817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-be888dd8-1c5f-498e-ac86-5a38adba5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:55.819890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 986/1988] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:55.822952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2bd9c-10c7-4f68-b348-8a9b75b21d72 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:55.831698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:55.838704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2bd9c-10c7-4f68-b348-8a9b75b21d72 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:55.858604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:55.858801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:55.858915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:55.859185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:55.859867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:30:55.860171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:55.861824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:55.900915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888dd8-1c5f-498e-ac86-5a38adba5db6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:55.909660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1003/1989] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:30:55.914433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888dd8-1c5f-498e-ac86-5a38adba5db6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:55.922548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:55.923349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:55.923780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:55.929813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:55.933023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:55.937085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:55.963414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:56.026566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 987/1990] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:30:55 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:30:56.032405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:56.045415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbffaa-5d2f-4f54-8c09-abe63101b263 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:56.167952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:56.168723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:56.169259 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:56.169637 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:56.170391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:56.172724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:56.201244 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1004/1991] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:30:56 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:30:56.207558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:56.221864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd0e0f-349e-4b86-b2f8-09736b41fc60 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:56.227081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:56.227719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:56.228078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:56.228482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:56.229131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:56.230733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:56.243405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 988/1992] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:56.247007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:56.257953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8daa1-5790-4d52-aaa3-2fe597798aef admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:56.267162 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd0c5-e18c-4d0a-ba9d-71b5dc91d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:56.268003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd0c5-e18c-4d0a-ba9d-71b5dc91d788 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:56.269105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd0c5-e18c-4d0a-ba9d-71b5dc91d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:56.269581 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd0c5-e18c-4d0a-ba9d-71b5dc91d788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:56.270231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd0c5-e18c-4d0a-ba9d-71b5dc91d788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:56.272247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd0c5-e18c-4d0a-ba9d-71b5dc91d788 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:56.286183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1005/1993] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:30:56.290323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:56.302669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587cbc1-0e18-4608-bda3-ace6d2562a51 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:56.307972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:56.308773 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:56.309156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:56.309549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] PATH_INFO: `/v3/projects/74758ab03aaa43e69ee1ad0a645092cb/users/fa4adf7e831748d9b50dc76558b5d99a/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:56.327360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74758ab03aaa43e69ee1ad0a645092cb, user_id=fa4adf7e831748d9b50dc76558b5d99a, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:56.330049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:56.353807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 989/1994] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:30:56 2022] PUT /identity/v3/projects/74758ab03aaa43e69ee1ad0a645092cb/users/fa4adf7e831748d9b50dc76558b5d99a/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:30:56.355925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378501-bb0f-439b-b886-4516810a9107 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:56.356288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378501-bb0f-439b-b886-4516810a9107 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:56.356676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378501-bb0f-439b-b886-4516810a9107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:56.387018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a9378501-bb0f-439b-b886-4516810a9107 None None] MFA Rules not processed for user `fa4adf7e831748d9b50dc76558b5d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:56.388390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a9378501-bb0f-439b-b886-4516810a9107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:56.472196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1006/1995] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:56.483627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:56.485986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:56.597147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cce5aa-8034-4bc7-bb53-eae433b24113 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:56.622932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:56.624727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:56.625175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:56.625596 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:56.645233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:56.647294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:56.663109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 990/1996] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:30:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:30:57.011335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c87ef-9bb7-4e4a-9e9f-2ac0fd164e71 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:57.012478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c87ef-9bb7-4e4a-9e9f-2ac0fd164e71 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:57.012907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c87ef-9bb7-4e4a-9e9f-2ac0fd164e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:57.068990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-769c87ef-9bb7-4e4a-9e9f-2ac0fd164e71 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:57.070251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-769c87ef-9bb7-4e4a-9e9f-2ac0fd164e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:57.201664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1007/1997] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:30:57.222139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:30:57.223916 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:57.349226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ddddf-7843-493e-b96a-c4e434a57b85 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:30:57.359052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8c0cc-b54c-4b52-a708-f1bb06e1dbbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:30:57.360032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c0cc-b54c-4b52-a708-f1bb06e1dbbd service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:57.360659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c0cc-b54c-4b52-a708-f1bb06e1dbbd service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:57.361143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c0cc-b54c-4b52-a708-f1bb06e1dbbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:57.383033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8c0cc-b54c-4b52-a708-f1bb06e1dbbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:30:57.384739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8c0cc-b54c-4b52-a708-f1bb06e1dbbd service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:30:57.400442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 991/1998] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:30:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:30:58.255639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231133b1-58eb-470a-8ab4-49eb42682a37 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:30:58.257012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231133b1-58eb-470a-8ab4-49eb42682a37 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:30:58.257635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231133b1-58eb-470a-8ab4-49eb42682a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:30:58.269150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:58.287338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-231133b1-58eb-470a-8ab4-49eb42682a37 None None] MFA Rules not processed for user `fa4adf7e831748d9b50dc76558b5d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:30:58.290858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-231133b1-58eb-470a-8ab4-49eb42682a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:30:58.318145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1008/1999] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:30:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:07.393404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:08.279926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:08.835464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e5404-9582-44dc-83b5-cc131986783e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:08.836009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e5404-9582-44dc-83b5-cc131986783e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:08.836116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e5404-9582-44dc-83b5-cc131986783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:08.874242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-324e5404-9582-44dc-83b5-cc131986783e None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:08.875817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-324e5404-9582-44dc-83b5-cc131986783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:08.885294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 992/2000] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:31:08.901568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231133b1-58eb-470a-8ab4-49eb42682a37 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:08.937199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231133b1-58eb-470a-8ab4-49eb42682a37 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:08.956201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:08.956699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:08.956985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:08.957263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:08.972799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:08.982276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:09.014182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1009/2001] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:31:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:31:15.798169 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e5404-9582-44dc-83b5-cc131986783e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:15.800983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-324e5404-9582-44dc-83b5-cc131986783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:16.032251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e5404-9582-44dc-83b5-cc131986783e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:16.068972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:16.079291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:16.085949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:16.087162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] PATH_INFO: `/v3/users/af309000477d4209890177639b3c2103` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:16.099356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af309000477d4209890177639b3c2103)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:16.113891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:16.276363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af309000477d4209890177639b3c2103'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:16.277078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af309000477d4209890177639b3c2103'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:16.289794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af309000477d4209890177639b3c2103'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:16.290790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af309000477d4209890177639b3c2103'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:16.309507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af309000477d4209890177639b3c2103'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:16.325076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 993/2002] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:31:15 2022] DELETE /identity/v3/users/af309000477d4209890177639b3c2103 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:16.729758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:16.752033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3aab2-4f77-4486-84af-0c51563513cc service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:16.898248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:16.899142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:16.899870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:16.900535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] PATH_INFO: `/v3/projects/71bccd6b96b84f5893ffbe91343fc878` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:16.902609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bccd6b96b84f5893ffbe91343fc878)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:16.907953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:17.020210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bccd6b96b84f5893ffbe91343fc878', 'request_id': 'req-e4b42636-1e0b-4162-a911-9a07c272edc9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.033185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bccd6b96b84f5893ffbe91343fc878', 'request_id': 'req-e4b42636-1e0b-4162-a911-9a07c272edc9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.046384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bccd6b96b84f5893ffbe91343fc878', 'request_id': 'req-e4b42636-1e0b-4162-a911-9a07c272edc9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.065993 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] The token cache is being invalidate because project 71bccd6b96b84f5893ffbe91343fc878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:31:17.066245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.067105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.074910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1010/2003] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:31:16 2022] DELETE /identity/v3/projects/71bccd6b96b84f5893ffbe91343fc878 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:17.080907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:17.082329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:17.118039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30051f37-5b85-43a9-a824-4ccc4409e127 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:17.216016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:17.217096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:17.218121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:17.218560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] PATH_INFO: `/v3/users/9faec55668c14b169085968f7a9c54eb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:17.220004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9faec55668c14b169085968f7a9c54eb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:17.223438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:17.249588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:17.320181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9faec55668c14b169085968f7a9c54eb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.321416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9faec55668c14b169085968f7a9c54eb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.347862 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9faec55668c14b169085968f7a9c54eb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.349356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9faec55668c14b169085968f7a9c54eb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.376684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1439e459-c3e3-42dd-80b5-3e12619b826e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9faec55668c14b169085968f7a9c54eb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:17.396667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 994/2004] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:31:17 2022] DELETE /identity/v3/users/9faec55668c14b169085968f7a9c54eb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:17.956622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:17.959910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:17.996634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b42636-1e0b-4162-a911-9a07c272edc9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:18.148986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:18.150004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:18.150444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:18.150869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] PATH_INFO: `/v3/projects/4a187302d98d483eb9edfdd2ebc8c003` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:18.152376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a187302d98d483eb9edfdd2ebc8c003)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:18.174855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:18.290191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:18.326519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a187302d98d483eb9edfdd2ebc8c003', 'request_id': 'req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:18.340902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a187302d98d483eb9edfdd2ebc8c003', 'request_id': 'req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:18.367950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a187302d98d483eb9edfdd2ebc8c003', 'request_id': 'req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:18.396677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] The token cache is being invalidate because project 4a187302d98d483eb9edfdd2ebc8c003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:31:18.396677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:18.398189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cbc8c073-a998-43d3-bfa0-a8a6f5a9d095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:18.401549 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1011/2005] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:31:17 2022] DELETE /identity/v3/projects/4a187302d98d483eb9edfdd2ebc8c003 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:18.407548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a48465-ec84-4f65-93e2-2dc69be98e08 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:18.408416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a48465-ec84-4f65-93e2-2dc69be98e08 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:18.408416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a48465-ec84-4f65-93e2-2dc69be98e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:18.451882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a2a48465-ec84-4f65-93e2-2dc69be98e08 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:18.456306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a2a48465-ec84-4f65-93e2-2dc69be98e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:18.544563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264962b4-c119-4150-add4-decf9d448a72 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:18.544833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264962b4-c119-4150-add4-decf9d448a72 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:18.545018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264962b4-c119-4150-add4-decf9d448a72 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:18.546596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1012/2006] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:31:18.556812 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcde8f-7dbc-48da-b360-5f3acb9a0454 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:18.557170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcde8f-7dbc-48da-b360-5f3acb9a0454 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:18.557386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcde8f-7dbc-48da-b360-5f3acb9a0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:18.619096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e9bcde8f-7dbc-48da-b360-5f3acb9a0454 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:18.620320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e9bcde8f-7dbc-48da-b360-5f3acb9a0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:18.673689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 995/2007] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:18.690143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d8362-fe45-453e-a28f-ba9e7abfe15c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:18.690426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d8362-fe45-453e-a28f-ba9e7abfe15c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:18.690907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d8362-fe45-453e-a28f-ba9e7abfe15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:18.734234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-655d8362-fe45-453e-a28f-ba9e7abfe15c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:18.735417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-655d8362-fe45-453e-a28f-ba9e7abfe15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:18.782663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 996/2008] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:18.789424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d8362-fe45-453e-a28f-ba9e7abfe15c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:18.804079 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d8362-fe45-453e-a28f-ba9e7abfe15c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:18.814401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:18.815036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:18.815318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:18.815587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:18.817979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:31:18.818697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:18.823948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:18.862200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 997/2009] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:31:18.865229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1013/2010] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:31:18.870041 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:18.891604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a27e-15da-4f08-acee-5a3d00879721 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:18.906586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:18.907276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:18.907564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:18.907865 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:18.908520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:18.910661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:18.966362 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcde8f-7dbc-48da-b360-5f3acb9a0454 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:18.968285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 998/2011] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:31:18 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:31:18.981609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcde8f-7dbc-48da-b360-5f3acb9a0454 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:19.141818 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:19.142595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:19.144371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:19.146007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:19.147787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:19.157278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:19.231452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1014/2012] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:31:18 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:31:19.235897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:19.251759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a589a5e-53f2-4115-b73c-a1bc3bab8fe2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:19.268305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:19.269088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:19.269459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:19.269877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:19.270733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:19.272531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:19.296351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 999/2013] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:31:19.296939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:19.317434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293837-a92b-4299-b2f5-9f1b0ca13d63 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:19.353578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6ca5-9f5e-4d49-8acc-60a4a9f00af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:19.354791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6ca5-9f5e-4d49-8acc-60a4a9f00af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:19.355080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6ca5-9f5e-4d49-8acc-60a4a9f00af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:19.355440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6ca5-9f5e-4d49-8acc-60a4a9f00af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:19.356223 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6ca5-9f5e-4d49-8acc-60a4a9f00af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:19.361018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6ca5-9f5e-4d49-8acc-60a4a9f00af0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:19.384037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1015/2014] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:31:19.388993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:19.407272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd77c-f08f-4c09-9bff-21b9e4b5ad21 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:19.428739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:19.429459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:19.429688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:19.429966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] PATH_INFO: `/v3/projects/a8e54a6aa6a3451bb7aa7c00c26a86bc/users/a59b5a57dac1419badb2d7b2d3fea4e6/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:19.493400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e54a6aa6a3451bb7aa7c00c26a86bc, user_id=a59b5a57dac1419badb2d7b2d3fea4e6, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:19.498283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:19.556918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1000/2015] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:31:19 2022] PUT /identity/v3/projects/a8e54a6aa6a3451bb7aa7c00c26a86bc/users/a59b5a57dac1419badb2d7b2d3fea4e6/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:19.558104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:19.558398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:19.558699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:19.616225 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:19.617530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:19.653058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:19.829835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1016/2016] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:19.838565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:19.840614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:19.893709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:20.010555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6773e-f8e3-42cb-9545-6810252a3ec9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:20.017175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3302-9ff1-4a19-ae00-02a036777eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:20.017809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3302-9ff1-4a19-ae00-02a036777eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:20.018641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3302-9ff1-4a19-ae00-02a036777eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:20.018914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3302-9ff1-4a19-ae00-02a036777eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:20.032835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3302-9ff1-4a19-ae00-02a036777eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:20.034470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3302-9ff1-4a19-ae00-02a036777eb5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:20.059126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1001/2017] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:20.216236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:20.217938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:20.323173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbbe0-fe1e-41c4-b3aa-75bbca0904bf None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:20.333543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15507e-a6a9-45ae-a58f-8b83137ceea3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fb6adedea24758bd852be1702cd1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:20.334172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15507e-a6a9-45ae-a58f-8b83137ceea3 service glance] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:20.334459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15507e-a6a9-45ae-a58f-8b83137ceea3 service glance] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:20.334734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15507e-a6a9-45ae-a58f-8b83137ceea3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:20.550830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15507e-a6a9-45ae-a58f-8b83137ceea3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:20.556750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15507e-a6a9-45ae-a58f-8b83137ceea3 service glance] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:20.594906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1017/2018] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:31:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:20.907182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9076-f92b-4482-8d60-0582c288ac27 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:20.907821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9076-f92b-4482-8d60-0582c288ac27 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:20.908282 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9076-f92b-4482-8d60-0582c288ac27 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:20.909653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1002/2019] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:31:20.921964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc840ed-f76f-4638-99a4-385cc079b126 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:20.922585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc840ed-f76f-4638-99a4-385cc079b126 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:20.923206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc840ed-f76f-4638-99a4-385cc079b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:20.967230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3fc840ed-f76f-4638-99a4-385cc079b126 None None] MFA Rules not processed for user `319b5538054c49d19ecc0b9c9cfc5b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:20.968646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3fc840ed-f76f-4638-99a4-385cc079b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:20.984164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1018/2020] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:21.030249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9076-f92b-4482-8d60-0582c288ac27 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:21.053310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9076-f92b-4482-8d60-0582c288ac27 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:21.067011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5976751-a2b9-436a-a878-2cb33273af71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:21.067976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5976751-a2b9-436a-a878-2cb33273af71 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:21.068421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5976751-a2b9-436a-a878-2cb33273af71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:21.068856 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5976751-a2b9-436a-a878-2cb33273af71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:21.088716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5976751-a2b9-436a-a878-2cb33273af71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:21.091508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5976751-a2b9-436a-a878-2cb33273af71 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:21.116263 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1003/2021] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:21.390705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:21.391226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:21.391226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:21.433378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:21.435360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:21.455646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371c051-af21-42f5-86ab-14cdba8b4f97 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:21.456306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371c051-af21-42f5-86ab-14cdba8b4f97 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:21.456772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371c051-af21-42f5-86ab-14cdba8b4f97 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:21.458962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1004/2022] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:31:21.467426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c2653-c402-40b5-a5be-c449305842f9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:21.468341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c2653-c402-40b5-a5be-c449305842f9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:21.468815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c2653-c402-40b5-a5be-c449305842f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:21.499275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:21.507569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-733c2653-c402-40b5-a5be-c449305842f9 None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:21.509594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-733c2653-c402-40b5-a5be-c449305842f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:21.512780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1019/2023] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 12 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:21.520832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1005/2024] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:31:21.534060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:21.536488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:21.540097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c2653-c402-40b5-a5be-c449305842f9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:21.563469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c2653-c402-40b5-a5be-c449305842f9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:21.575198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ee172-7ea7-4cdc-851a-41ecac1ff748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:21.576752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee172-7ea7-4cdc-851a-41ecac1ff748 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:21.577685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee172-7ea7-4cdc-851a-41ecac1ff748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:21.578536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee172-7ea7-4cdc-851a-41ecac1ff748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:21.630022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ee172-7ea7-4cdc-851a-41ecac1ff748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:21.631493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ee172-7ea7-4cdc-851a-41ecac1ff748 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:21.659116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1006/2025] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:21.662273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a2ce-d29e-4663-9edf-6a8911b61e02 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:21.663000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a2ce-d29e-4663-9edf-6a8911b61e02 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:21.663692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a2ce-d29e-4663-9edf-6a8911b61e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:21.724578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b402a2ce-d29e-4663-9edf-6a8911b61e02 None None] MFA Rules not processed for user `a59b5a57dac1419badb2d7b2d3fea4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:21.726039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1b9fd-488c-4048-b236-5ea122739ee0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:21.728712 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b402a2ce-d29e-4663-9edf-6a8911b61e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:21.735234 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:21.736101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:21.736380 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:21.736655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:21.792687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:21.794848 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:21.834687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1020/2026] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:31:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:31:21.908915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1007/2027] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:21.922061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:21.924810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:22.037588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378d7be-8d64-46f7-9945-8c2ecba2dec3 service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:22.049000 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:22.050392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:22.051131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:22.051944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:22.087753 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:22.092267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:22.130979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1021/2028] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:23.810774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e783-3784-4689-852d-893651c355f4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:23.811446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e783-3784-4689-852d-893651c355f4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:23.811446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e783-3784-4689-852d-893651c355f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:23.832103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5732e783-3784-4689-852d-893651c355f4 None None] MFA Rules not processed for user `a59b5a57dac1419badb2d7b2d3fea4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:23.833588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5732e783-3784-4689-852d-893651c355f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:23.841376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1008/2029] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:31:24.821904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:24.823938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:24.848171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6b2a-cc52-43e8-a066-4a9a213d0ec9 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:24.853870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:24.855729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:24.856239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:24.856677 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] PATH_INFO: `/v3/users/c0dd49c1b3b242558a40b6e798e952f7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:24.858138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0dd49c1b3b242558a40b6e798e952f7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:24.860272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:24.922176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0dd49c1b3b242558a40b6e798e952f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:24.923529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0dd49c1b3b242558a40b6e798e952f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:24.938835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0dd49c1b3b242558a40b6e798e952f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:24.939574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0dd49c1b3b242558a40b6e798e952f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:24.953156 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c62ff50f-8f79-4d86-a071-9ee3848cff13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0dd49c1b3b242558a40b6e798e952f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:24.977593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1022/2030] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:31:24 2022] DELETE /identity/v3/users/c0dd49c1b3b242558a40b6e798e952f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:25.176236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e783-3784-4689-852d-893651c355f4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:25.192219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e783-3784-4689-852d-893651c355f4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:25.303012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:25.304126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.304751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.305234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] PATH_INFO: `/v3/projects/a32c8beca89e4396a6ad67c5deaea32b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.306776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32c8beca89e4396a6ad67c5deaea32b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:25.310020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:25.327033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:25.412161 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32c8beca89e4396a6ad67c5deaea32b', 'request_id': 'req-3358e9dc-5686-46b8-a4b4-2870177707b9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:25.428870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32c8beca89e4396a6ad67c5deaea32b', 'request_id': 'req-3358e9dc-5686-46b8-a4b4-2870177707b9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:25.436460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32c8beca89e4396a6ad67c5deaea32b', 'request_id': 'req-3358e9dc-5686-46b8-a4b4-2870177707b9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:25.449780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] The token cache is being invalidate because project a32c8beca89e4396a6ad67c5deaea32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:31:25.449780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:25.450326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3358e9dc-5686-46b8-a4b4-2870177707b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:31:25.452074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1009/2031] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:31:25 2022] DELETE /identity/v3/projects/a32c8beca89e4396a6ad67c5deaea32b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:25.457094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bec8a-0c9e-46ae-a464-afe877d490f0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.457413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bec8a-0c9e-46ae-a464-afe877d490f0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.457685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bec8a-0c9e-46ae-a464-afe877d490f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.466210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:25.481392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-540bec8a-0c9e-46ae-a464-afe877d490f0 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:25.483736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-540bec8a-0c9e-46ae-a464-afe877d490f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:25.563913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1023/2032] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:25.572786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121aee0-22c7-4620-948a-ba9ef6c496b6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.574547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121aee0-22c7-4620-948a-ba9ef6c496b6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.575061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121aee0-22c7-4620-948a-ba9ef6c496b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.603598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4121aee0-22c7-4620-948a-ba9ef6c496b6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:25.605386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4121aee0-22c7-4620-948a-ba9ef6c496b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:25.614767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1010/2033] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:25.618974 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bec8a-0c9e-46ae-a464-afe877d490f0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:25.630533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bec8a-0c9e-46ae-a464-afe877d490f0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:25.637207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:25.637839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.638129 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.638385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.639041 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:31:25.639534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:25.642386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:25.656118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1024/2034] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:31:25.660527 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121aee0-22c7-4620-948a-ba9ef6c496b6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:25.670276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121aee0-22c7-4620-948a-ba9ef6c496b6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:25.676031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:25.676713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.677082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.677423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.678135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:25.680132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:25.727148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1011/2035] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:31:25 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:31:25.731253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:25.744619 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cea48e-1fde-4b83-8e52-2aa35088b2fb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:25.830575 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:25.831257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.831579 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.831924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.832578 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:25.834868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:25.862457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1025/2036] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:31:25 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:31:25.867363 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:25.878995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446f640-c5ba-45f8-a088-4ca16fe57c92 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:25.883817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:25.884897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.885184 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.885460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.886650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:25.888288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:25.898662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1012/2037] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:31:25.903193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:25.914233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9970b96-0048-4be0-ace9-7a156163c6b4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:25.919489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817c6f-f719-451b-a94e-01d664e61401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:25.920264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817c6f-f719-451b-a94e-01d664e61401 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.920546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817c6f-f719-451b-a94e-01d664e61401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.920821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817c6f-f719-451b-a94e-01d664e61401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.921616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817c6f-f719-451b-a94e-01d664e61401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:25.923211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817c6f-f719-451b-a94e-01d664e61401 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:25.935996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1026/2038] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:31:25.939869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:25.961719 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45633-faf6-44d5-8423-eebfbbd46da4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:25.967829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:25.968511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:25.968794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:25.969739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] PATH_INFO: `/v3/projects/062a1326ae5041ef81d044b370234945/users/320b3f54078c443694832af39cf5b7c1/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:25.995880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062a1326ae5041ef81d044b370234945, user_id=320b3f54078c443694832af39cf5b7c1, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:25.998565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:26.014106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1013/2039] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:31:25 2022] PUT /identity/v3/projects/062a1326ae5041ef81d044b370234945/users/320b3f54078c443694832af39cf5b7c1/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:31:26.025457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60876be0-2977-4d30-bb1c-49bd505e3d23 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:26.025980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60876be0-2977-4d30-bb1c-49bd505e3d23 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:26.026369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60876be0-2977-4d30-bb1c-49bd505e3d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:26.056344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-60876be0-2977-4d30-bb1c-49bd505e3d23 None None] MFA Rules not processed for user `320b3f54078c443694832af39cf5b7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:26.058328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-60876be0-2977-4d30-bb1c-49bd505e3d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:26.125935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:26.133027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1027/2040] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:26.144559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:26.146801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:26.236160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50231e9-3950-4e72-86a0-bab3c0cc6f35 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:26.241261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:26.242101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:26.242564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:26.242984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:26.252795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:26.254314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:26.266176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1014/2041] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:33.115415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:33.116357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:33.116837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:33.139598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:33.140882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:33.219525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1028/2042] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:33.234399 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:33.235851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:33.294252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:33.367940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef86755-5b7a-46b2-ba3f-6383aee7d253 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:33.385456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b38b4-36dc-469b-b5e7-4108a8dd1da4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:33.386310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b38b4-36dc-469b-b5e7-4108a8dd1da4 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:33.387259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b38b4-36dc-469b-b5e7-4108a8dd1da4 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:33.387842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b38b4-36dc-469b-b5e7-4108a8dd1da4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:33.398464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b38b4-36dc-469b-b5e7-4108a8dd1da4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:33.401246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b38b4-36dc-469b-b5e7-4108a8dd1da4 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:33.414497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1015/2043] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:31:43.209307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=26 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:43.409637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=15 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:51.400934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:51.402368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:51.471849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45358d3-2282-4729-8fd6-be2f84524963 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:51.476013 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:51.476618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:51.476897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:51.477199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:51.479004 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:51.544381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:51.546059 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:51.562736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1029/2044] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:31:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:58.141059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212fac6-ebea-4158-a104-0eeab988739e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:58.142077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212fac6-ebea-4158-a104-0eeab988739e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:58.142532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212fac6-ebea-4158-a104-0eeab988739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:58.168482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5212fac6-ebea-4158-a104-0eeab988739e None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:31:58.170576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5212fac6-ebea-4158-a104-0eeab988739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:31:58.181425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1016/2045] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 12 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:31:58.210457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:31:58.225271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37c526-a537-4762-a7e7-f738c098dfa9 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:31:58.232155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:31:58.232936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:31:58.233316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:31:58.233703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:31:58.243070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:31:58.244989 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:31:58.257128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1030/2046] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:32:00.529700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86095-04bc-4ddc-93c1-e4f6689d709a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:00.530217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86095-04bc-4ddc-93c1-e4f6689d709a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:00.530217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86095-04bc-4ddc-93c1-e4f6689d709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:00.550277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a8d86095-04bc-4ddc-93c1-e4f6689d709a None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:00.552441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a8d86095-04bc-4ddc-93c1-e4f6689d709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:00.561625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1017/2047] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:32:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:00.580780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:00.592408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb39763-875a-452f-a245-7f298b993628 service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:00.599087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebc6c6-4f10-4583-ab3f-8b7adc5b3ef1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:00.599718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc6c6-4f10-4583-ab3f-8b7adc5b3ef1 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:00.600019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc6c6-4f10-4583-ab3f-8b7adc5b3ef1 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:00.600477 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc6c6-4f10-4583-ab3f-8b7adc5b3ef1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:00.609364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebc6c6-4f10-4583-ab3f-8b7adc5b3ef1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:00.611219 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebc6c6-4f10-4583-ab3f-8b7adc5b3ef1 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:00.620971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1031/2048] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:32:01.062444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86095-04bc-4ddc-93c1-e4f6689d709a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:01.137967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86095-04bc-4ddc-93c1-e4f6689d709a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:01.143024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:01.143561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.143873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.144151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] PATH_INFO: `/v3/users/320b3f54078c443694832af39cf5b7c1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.145810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=320b3f54078c443694832af39cf5b7c1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:01.147720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:01.169366 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfab22-a743-47a2-b5ea-627047e7459b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.169690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfab22-a743-47a2-b5ea-627047e7459b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.170153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfab22-a743-47a2-b5ea-627047e7459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.192462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1cbfab22-a743-47a2-b5ea-627047e7459b None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:01.193809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1cbfab22-a743-47a2-b5ea-627047e7459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:01.200551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320b3f54078c443694832af39cf5b7c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.201214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320b3f54078c443694832af39cf5b7c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.202566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1032/2049] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 12 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:01.215322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320b3f54078c443694832af39cf5b7c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.215956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320b3f54078c443694832af39cf5b7c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.220095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfab22-a743-47a2-b5ea-627047e7459b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:01.242720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfab22-a743-47a2-b5ea-627047e7459b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:01.243956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-30fb822c-4516-4018-ab1a-e318b5845b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320b3f54078c443694832af39cf5b7c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.249499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:01.250171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.250454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.250727 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.252536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:01.260693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1018/2050] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:32:01 2022] DELETE /identity/v3/users/320b3f54078c443694832af39cf5b7c1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:01.266582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:01.266902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f271-f7ac-4114-ad31-85bb77864523 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.267286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f271-f7ac-4114-ad31-85bb77864523 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.268474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f271-f7ac-4114-ad31-85bb77864523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.269494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:01.281938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1033/2051] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 12:32:01.302362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2482f271-f7ac-4114-ad31-85bb77864523 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:01.304339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2482f271-f7ac-4114-ad31-85bb77864523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:01.374115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1019/2052] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:01.384144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:01.385785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:01.397959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b5b4-11f6-41af-84d3-8dbabbfda8ce service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:01.449764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:01.450369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.450702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.450977 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.460659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:01.462033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:01.471780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1034/2053] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:32:01.564062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.564544 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.564626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.579278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:01.586587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:01.588858 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:01.651280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1020/2054] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:01.673083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:01.674725 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:01.685048 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:01.748536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9e5b-a81c-467b-ad06-40e4da7f44f6 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:01.753487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf189ce-3728-4c22-ae07-be7578afeb80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:01.754614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf189ce-3728-4c22-ae07-be7578afeb80 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.754904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf189ce-3728-4c22-ae07-be7578afeb80 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.755177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf189ce-3728-4c22-ae07-be7578afeb80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.769408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf189ce-3728-4c22-ae07-be7578afeb80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:01.771648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf189ce-3728-4c22-ae07-be7578afeb80 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:01.782134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1035/2055] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:32:01.816539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:01.818568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:01.846528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546097b3-18a8-429a-b8d3-103f42540f11 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:01.859112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:01.860528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.861756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.862245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] PATH_INFO: `/v3/projects/062a1326ae5041ef81d044b370234945` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:01.863689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=062a1326ae5041ef81d044b370234945)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:01.866117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:01.924058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062a1326ae5041ef81d044b370234945', 'request_id': 'req-7c7e6c9a-1373-416d-82a0-badf51a417fe'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.934413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062a1326ae5041ef81d044b370234945', 'request_id': 'req-7c7e6c9a-1373-416d-82a0-badf51a417fe'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.942922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062a1326ae5041ef81d044b370234945', 'request_id': 'req-7c7e6c9a-1373-416d-82a0-badf51a417fe'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.959623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] The token cache is being invalidate because project 062a1326ae5041ef81d044b370234945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:32:01.960136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.960872 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7c7e6c9a-1373-416d-82a0-badf51a417fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:01.963882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1021/2056] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:32:01 2022] DELETE /identity/v3/projects/062a1326ae5041ef81d044b370234945 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:01.968913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2716-4b9e-48aa-95b6-5ca4398743aa None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:01.969412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2716-4b9e-48aa-95b6-5ca4398743aa None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:01.970003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2716-4b9e-48aa-95b6-5ca4398743aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.005425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-942c2716-4b9e-48aa-95b6-5ca4398743aa None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:02.006690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-942c2716-4b9e-48aa-95b6-5ca4398743aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.055277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b51b48-f2e0-4ff9-b825-fe6c5c3c18de None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.055772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b51b48-f2e0-4ff9-b825-fe6c5c3c18de None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.056367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b51b48-f2e0-4ff9-b825-fe6c5c3c18de None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.057761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1022/2057] 10.222.0.45 () {54 vars in 961 bytes} [Wed Oct 12 12:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:32:02.063931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750611c-7b09-4015-b25f-8b46d8f96d82 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.064469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750611c-7b09-4015-b25f-8b46d8f96d82 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.064749 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750611c-7b09-4015-b25f-8b46d8f96d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.090018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1036/2058] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:02.096660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9750611c-7b09-4015-b25f-8b46d8f96d82 None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:02.096660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9750611c-7b09-4015-b25f-8b46d8f96d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.098351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974cb0b-65c6-4df3-be98-b6152f0e3c5c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.098647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974cb0b-65c6-4df3-be98-b6152f0e3c5c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.099063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974cb0b-65c6-4df3-be98-b6152f0e3c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.146838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3974cb0b-65c6-4df3-be98-b6152f0e3c5c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:02.152606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3974cb0b-65c6-4df3-be98-b6152f0e3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.168464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1037/2059] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:32:02.173651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974cb0b-65c6-4df3-be98-b6152f0e3c5c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.174253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1023/2060] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Oct 12 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:02.184132 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750611c-7b09-4015-b25f-8b46d8f96d82 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.185709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974cb0b-65c6-4df3-be98-b6152f0e3c5c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.193906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829584-af1a-4618-9e0f-bc03359cc09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.195912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829584-af1a-4618-9e0f-bc03359cc09f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.197106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829584-af1a-4618-9e0f-bc03359cc09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.197542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829584-af1a-4618-9e0f-bc03359cc09f admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.198351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95829584-af1a-4618-9e0f-bc03359cc09f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:32:02.198821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95829584-af1a-4618-9e0f-bc03359cc09f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.200187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750611c-7b09-4015-b25f-8b46d8f96d82 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.200817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95829584-af1a-4618-9e0f-bc03359cc09f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.209921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.210567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.210853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.211134 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.216577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.229877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1038/2061] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:32:02.229877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.229877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.229877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.234283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.236118 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.248893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1024/2062] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:32:02.249966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.262723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661562a1-2146-4e8c-a91a-739910dcc9b7 service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.266936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:02.269905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.275615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.276508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.276870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.277312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.278054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.280229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.299388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:02.331402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1025/2063] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:32:02 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:32:02.333014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.360856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1039/2064] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 12 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 12:32:02.383111 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.384945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.408746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26942-1575-4686-995d-89410d1ef94d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.420703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.421595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.422166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.422617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.423428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.425571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:02.426011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.460476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1026/2065] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:32:02 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:32:02.461450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.474312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfda79-ec62-4b91-ba31-dbefbb977e35 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.478966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.479921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.480838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.480838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.481290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.482902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.487161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1652ab-be2a-4c8c-81e3-777c0b75e64a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.493812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1027/2066] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:32:02.497725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.508418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d515cf-1285-4d84-a5e6-5a56018e54d0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.513628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.514230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.514512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.514783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.515425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.517122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.529486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1028/2067] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:32:02.533622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.543746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ded187-69f2-419f-99fd-c6ac3a0ca8be admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.548506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf005ac-a860-48f2-9d94-6fb7920ee32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.549167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf005ac-a860-48f2-9d94-6fb7920ee32b admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.549449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf005ac-a860-48f2-9d94-6fb7920ee32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.549720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf005ac-a860-48f2-9d94-6fb7920ee32b admin admin] PATH_INFO: `/v3/projects/37bb68026e68430287e8fb91b5e6b0f7/users/ad947f3135244459a162fc162d814cd5/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.558740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.559361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.559639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.560286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.565826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf005ac-a860-48f2-9d94-6fb7920ee32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37bb68026e68430287e8fb91b5e6b0f7, user_id=ad947f3135244459a162fc162d814cd5, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.569655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf005ac-a860-48f2-9d94-6fb7920ee32b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.584470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1029/2068] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:32:02 2022] PUT /identity/v3/projects/37bb68026e68430287e8fb91b5e6b0f7/users/ad947f3135244459a162fc162d814cd5/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:02.599626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3957b-c25f-4d22-a03e-9a12b2b79905 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.599959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3957b-c25f-4d22-a03e-9a12b2b79905 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.600242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3957b-c25f-4d22-a03e-9a12b2b79905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.631139 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.632895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.634006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1db3957b-c25f-4d22-a03e-9a12b2b79905 None None] MFA Rules not processed for user `ad947f3135244459a162fc162d814cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:02.635194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1db3957b-c25f-4d22-a03e-9a12b2b79905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.642360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1040/2069] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:32:02.706739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1030/2070] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:32:02.717897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.719397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:02.820007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f190bb1-a3e5-45a2-9de7-96da6c25540b service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:02.848808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:02.890388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfa5cf-2665-403a-9df8-159e93db7083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:02.891028 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfa5cf-2665-403a-9df8-159e93db7083 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:02.891315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfa5cf-2665-403a-9df8-159e93db7083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:02.891589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfa5cf-2665-403a-9df8-159e93db7083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:02.901313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfa5cf-2665-403a-9df8-159e93db7083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:02.902883 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfa5cf-2665-403a-9df8-159e93db7083 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:02.913285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1041/2071] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:02.947159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3957b-c25f-4d22-a03e-9a12b2b79905 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:02.980967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:03.022964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3957b-c25f-4d22-a03e-9a12b2b79905 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:03.028461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:03.029204 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:03.029558 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:03.029905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] PATH_INFO: `/v3/users/ad947f3135244459a162fc162d814cd5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:03.031120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad947f3135244459a162fc162d814cd5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:03.033279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:03.107460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad947f3135244459a162fc162d814cd5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:03.108202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad947f3135244459a162fc162d814cd5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:03.117939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad947f3135244459a162fc162d814cd5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:03.118571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad947f3135244459a162fc162d814cd5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:03.132344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad947f3135244459a162fc162d814cd5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:03.147444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1031/2072] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:32:02 2022] DELETE /identity/v3/users/ad947f3135244459a162fc162d814cd5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:03.160782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36052-cecf-4474-b59f-1e5da38606bf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:03.160782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36052-cecf-4474-b59f-1e5da38606bf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:03.160782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36052-cecf-4474-b59f-1e5da38606bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:03.172892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2fa36052-cecf-4474-b59f-1e5da38606bf None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:03.174101 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2fa36052-cecf-4474-b59f-1e5da38606bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:03.259183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1042/2073] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:03.269309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:03.272069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:03.353533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3447233-87b8-44d3-8d93-130d26269147 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:03.367967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:03.367967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:03.367967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:03.367967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:03.384943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:03.387003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:03.394025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36052-cecf-4474-b59f-1e5da38606bf None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:03.402342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1032/2074] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:03.407667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36052-cecf-4474-b59f-1e5da38606bf None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:03.412191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f475ac7-3140-43fc-bd8c-903cee881c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:03.412815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f475ac7-3140-43fc-bd8c-903cee881c7a service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:03.413183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f475ac7-3140-43fc-bd8c-903cee881c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:03.413461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f475ac7-3140-43fc-bd8c-903cee881c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:03.416770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4f475ac7-3140-43fc-bd8c-903cee881c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:03.504163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f475ac7-3140-43fc-bd8c-903cee881c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:03.507922 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f475ac7-3140-43fc-bd8c-903cee881c7a service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:03.523467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1043/2075] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:32:04.013747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.015293 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:04.034774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3b40e-632d-4513-8333-643f118d0adf service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.062497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.062497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.062863 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.062945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] PATH_INFO: `/v3/projects/37bb68026e68430287e8fb91b5e6b0f7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.065033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37bb68026e68430287e8fb91b5e6b0f7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.067438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.124888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:04.129182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37bb68026e68430287e8fb91b5e6b0f7', 'request_id': 'req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:04.138920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37bb68026e68430287e8fb91b5e6b0f7', 'request_id': 'req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:04.145793 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37bb68026e68430287e8fb91b5e6b0f7', 'request_id': 'req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:04.157786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] The token cache is being invalidate because project 37bb68026e68430287e8fb91b5e6b0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:32:04.158253 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:04.159043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a197c2ed-0b20-4b07-a046-9a6f4eeb5504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:04.161180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1033/2076] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:32:04 2022] DELETE /identity/v3/projects/37bb68026e68430287e8fb91b5e6b0f7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:04.166182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee83f-2384-45e6-88fd-bc3a147f9ba6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.167035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee83f-2384-45e6-88fd-bc3a147f9ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.167314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee83f-2384-45e6-88fd-bc3a147f9ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.187009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-beaee83f-2384-45e6-88fd-bc3a147f9ba6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:04.188793 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-beaee83f-2384-45e6-88fd-bc3a147f9ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:04.244151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:04.254038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1044/2077] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:32:04.262364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11309c-0baa-4a52-b9c1-0e81c2f71a2c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.262588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11309c-0baa-4a52-b9c1-0e81c2f71a2c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.262860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11309c-0baa-4a52-b9c1-0e81c2f71a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.283681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ce11309c-0baa-4a52-b9c1-0e81c2f71a2c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:04.284953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ce11309c-0baa-4a52-b9c1-0e81c2f71a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:04.294196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1034/2078] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:04.298478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaee83f-2384-45e6-88fd-bc3a147f9ba6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.308308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaee83f-2384-45e6-88fd-bc3a147f9ba6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.314025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.314638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.315022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.315316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.316097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:32:04.316505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.318305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.332369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1045/2079] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:32:04.337229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11309c-0baa-4a52-b9c1-0e81c2f71a2c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.346556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11309c-0baa-4a52-b9c1-0e81c2f71a2c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.352855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.353520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.353769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.354042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.354687 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.356632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.385943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1035/2080] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:32:04 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:32:04.390122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.400773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac50f68-679a-4bd9-8d56-4841df332bf3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.459303 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.460012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.460399 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.460731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.461383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.463419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.489627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1046/2081] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:32:04 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:32:04.492521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.504630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2deaf46-8b3b-48b2-8c5b-8cac2c7e5954 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.509531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.510142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.510422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.510699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.511343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.513056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.524538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1036/2082] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:32:04.528636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.550318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f664d52-16a7-403f-84bc-63ff7d054ffb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.555485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05a2c-b733-458d-b2ea-18888db18152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.556196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a2c-b733-458d-b2ea-18888db18152 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.557777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a2c-b733-458d-b2ea-18888db18152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.558049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a2c-b733-458d-b2ea-18888db18152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.559055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec05a2c-b733-458d-b2ea-18888db18152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.560360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec05a2c-b733-458d-b2ea-18888db18152 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.572144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1047/2083] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:32:04.576402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.587339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9abc71-6b27-4345-a24d-ee7d0fea3bc3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.592500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.593271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.593517 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.593814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] PATH_INFO: `/v3/projects/761199e26de94eaf8d82bf9476b4e25d/users/9fa2686ea50d49caae5ef84e8f5b8475/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.610168 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=761199e26de94eaf8d82bf9476b4e25d, user_id=9fa2686ea50d49caae5ef84e8f5b8475, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.613122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.628338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1037/2084] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:32:04 2022] PUT /identity/v3/projects/761199e26de94eaf8d82bf9476b4e25d/users/9fa2686ea50d49caae5ef84e8f5b8475/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:04.638358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.638672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.638943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.666638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] MFA Rules not processed for user `9fa2686ea50d49caae5ef84e8f5b8475`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:04.667909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:04.747843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1048/2085] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:04.760451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:04.762208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:04.836505 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed36-f006-4937-8998-3cb60747c0ce admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:04.840769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f582ffd-e5f2-42f8-ab71-bad60839a492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:04.841407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f582ffd-e5f2-42f8-ab71-bad60839a492 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:04.841681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f582ffd-e5f2-42f8-ab71-bad60839a492 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:04.841949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f582ffd-e5f2-42f8-ab71-bad60839a492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:04.851025 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f582ffd-e5f2-42f8-ab71-bad60839a492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:04.852498 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f582ffd-e5f2-42f8-ab71-bad60839a492 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:04.861401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1038/2086] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:32:05.098520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:05.101188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:05.193556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:05.200621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444b2c-532e-498e-81a1-f73392393e5b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:05.208726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:05.209862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:05.210277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:05.210680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] PATH_INFO: `/v3/users/fa4adf7e831748d9b50dc76558b5d99a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:05.212630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4adf7e831748d9b50dc76558b5d99a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:05.216020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:05.313103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4adf7e831748d9b50dc76558b5d99a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.314229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4adf7e831748d9b50dc76558b5d99a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.330900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4adf7e831748d9b50dc76558b5d99a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.332757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4adf7e831748d9b50dc76558b5d99a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.360016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4adf7e831748d9b50dc76558b5d99a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.385995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1049/2087] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:32:05 2022] DELETE /identity/v3/users/fa4adf7e831748d9b50dc76558b5d99a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:05.388173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763653-a815-48d8-9576-b232ef744e8c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:05.388643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763653-a815-48d8-9576-b232ef744e8c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:05.388643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763653-a815-48d8-9576-b232ef744e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:05.471361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-40763653-a815-48d8-9576-b232ef744e8c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:05.473515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-40763653-a815-48d8-9576-b232ef744e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:05.569456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:05.571820 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:05.574379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1039/2088] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:32:05.647510 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50696f-6250-4ee0-b754-4b11eff5b4d4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:05.652336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:05.652851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:05.653038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:05.653312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:05.666214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:05.667777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:05.678792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1050/2089] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:32:05.854093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763653-a815-48d8-9576-b232ef744e8c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:05.855685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-40763653-a815-48d8-9576-b232ef744e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:05.869869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763653-a815-48d8-9576-b232ef744e8c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:05.875170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:05.876611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:05.876968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:05.877307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] PATH_INFO: `/v3/projects/74758ab03aaa43e69ee1ad0a645092cb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:05.879265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] RBAC: Authorizing `identity:delete_project(project_id=74758ab03aaa43e69ee1ad0a645092cb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:05.881755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:05.893130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:05.939372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74758ab03aaa43e69ee1ad0a645092cb', 'request_id': 'req-b83e38b2-dc67-437e-99a4-8eea7cafbdad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.947903 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74758ab03aaa43e69ee1ad0a645092cb', 'request_id': 'req-b83e38b2-dc67-437e-99a4-8eea7cafbdad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.953649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74758ab03aaa43e69ee1ad0a645092cb', 'request_id': 'req-b83e38b2-dc67-437e-99a4-8eea7cafbdad'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.967943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] The token cache is being invalidate because project 74758ab03aaa43e69ee1ad0a645092cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:32:05.968330 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.969148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b83e38b2-dc67-437e-99a4-8eea7cafbdad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:05.970908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1040/2090] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:32:05 2022] DELETE /identity/v3/projects/74758ab03aaa43e69ee1ad0a645092cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:10.153933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:10.155492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:10.168985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553d85-596f-4642-aa65-1c9ee7ff0d21 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:10.237915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:10.238679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:10.239064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:10.239968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] PATH_INFO: `/v3/users/9fa2686ea50d49caae5ef84e8f5b8475` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:10.240705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa2686ea50d49caae5ef84e8f5b8475)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:10.242722 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:10.269378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:10.312482 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa2686ea50d49caae5ef84e8f5b8475'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.313718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa2686ea50d49caae5ef84e8f5b8475'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.328756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa2686ea50d49caae5ef84e8f5b8475'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.329458 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa2686ea50d49caae5ef84e8f5b8475'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.337170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa2686ea50d49caae5ef84e8f5b8475'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.352763 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1051/2091] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:32:10 2022] DELETE /identity/v3/users/9fa2686ea50d49caae5ef84e8f5b8475 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:10.358111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:10.358589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:10.358685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:10.389755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:10.391078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:10.449529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1041/2092] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:10.459172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:10.460599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:10.520657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f17b3-c2be-455c-b8ec-23c4d724bd2e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:10.524191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251c5ba-a2ce-4a22-9982-f55efc2f30b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:10.524786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c5ba-a2ce-4a22-9982-f55efc2f30b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:10.525061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c5ba-a2ce-4a22-9982-f55efc2f30b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:10.525346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c5ba-a2ce-4a22-9982-f55efc2f30b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:10.533980 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251c5ba-a2ce-4a22-9982-f55efc2f30b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:10.535912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251c5ba-a2ce-4a22-9982-f55efc2f30b2 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:10.545112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1052/2093] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:10.826185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:10.827747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:10.842221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395f39f-5173-4534-a3e2-787823d29506 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:10.848410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:10.849047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:10.849327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:10.849602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] PATH_INFO: `/v3/projects/761199e26de94eaf8d82bf9476b4e25d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:10.850759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=761199e26de94eaf8d82bf9476b4e25d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:10.864145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:10.916113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761199e26de94eaf8d82bf9476b4e25d', 'request_id': 'req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.923690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761199e26de94eaf8d82bf9476b4e25d', 'request_id': 'req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.929512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761199e26de94eaf8d82bf9476b4e25d', 'request_id': 'req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.940853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] The token cache is being invalidate because project 761199e26de94eaf8d82bf9476b4e25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:32:10.941149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.941791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8eb71b32-414f-4111-88a8-f2bd1ae3cda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:32:10.943266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1042/2094] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:32:10 2022] DELETE /identity/v3/projects/761199e26de94eaf8d82bf9476b4e25d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:32:17.369950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:17.370439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:17.370641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:17.389598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] MFA Rules not processed for user `909a8fb02bf8468a9914e78b23c8ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:17.390773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:17.443331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1053/2095] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:19.414502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe1d9-a6ca-4102-a066-3a447a8409a2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:19.415041 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe1d9-a6ca-4102-a066-3a447a8409a2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:19.415215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe1d9-a6ca-4102-a066-3a447a8409a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:19.435061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0f6fe1d9-a6ca-4102-a066-3a447a8409a2 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:19.436293 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0f6fe1d9-a6ca-4102-a066-3a447a8409a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:19.449737 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:19.500208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1043/2096] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:19.547457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:19.549307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:19.608890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:19.650103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fecd2-5203-495b-81b2-c148f5e6f04a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:19.656367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:19.657198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:19.657486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:19.657808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:19.666929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:19.669325 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:19.679615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1054/2097] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:23.422866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1f81-5a7e-4374-9332-5c1681ed89d2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:23.423450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1f81-5a7e-4374-9332-5c1681ed89d2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:23.423450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1f81-5a7e-4374-9332-5c1681ed89d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:23.444544 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-741f1f81-5a7e-4374-9332-5c1681ed89d2 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:23.445747 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-741f1f81-5a7e-4374-9332-5c1681ed89d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:23.453567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1044/2098] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:23.478691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:23.490327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c6c2-1998-41a1-8200-8e7a2bd1f847 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:23.495834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:23.496412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:23.496693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:23.496966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:23.504991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:23.506555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:23.515705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1055/2099] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:27.706097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4fcf-4518-4a1e-bc2f-38aa511d301e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:27.706684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4fcf-4518-4a1e-bc2f-38aa511d301e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:27.706684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4fcf-4518-4a1e-bc2f-38aa511d301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:27.726441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d7cc4fcf-4518-4a1e-bc2f-38aa511d301e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:27.727636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d7cc4fcf-4518-4a1e-bc2f-38aa511d301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:27.735441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1045/2100] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:27.788510 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:27.789914 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:27.804644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbb183-74c7-4f0a-bf13-1ceb87ce4798 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:27.809999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:27.810576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:27.810855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:27.811381 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:27.819243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:27.820859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:27.829902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1056/2101] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:31.797327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f32527-0647-4a3a-8ba4-48c342949525 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:31.797791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f32527-0647-4a3a-8ba4-48c342949525 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:31.797907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f32527-0647-4a3a-8ba4-48c342949525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:31.818299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-66f32527-0647-4a3a-8ba4-48c342949525 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:31.819493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-66f32527-0647-4a3a-8ba4-48c342949525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:31.827145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1046/2102] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:31.851948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:31.862867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c278-be45-4b98-aaf8-9431600728e2 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:31.868856 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:31.869446 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:31.869726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:31.869998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:31.877915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:31.880119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:31.889355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1057/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:36.001731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b487d-022f-4ad1-aef4-985456dee086 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:36.002221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b487d-022f-4ad1-aef4-985456dee086 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:36.002329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b487d-022f-4ad1-aef4-985456dee086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:36.022124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f74b487d-022f-4ad1-aef4-985456dee086 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:36.023296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f74b487d-022f-4ad1-aef4-985456dee086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:36.030915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1047/2104] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:36.063688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:36.075193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2fbf2-0e99-4f9d-892f-1f0018e50012 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:36.080919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:36.081543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:36.082819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:36.083099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:36.091372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:36.092976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:36.102394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1058/2105] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:40.167270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dab79-9c18-4acd-83de-4cb2a3c9578f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:40.167790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dab79-9c18-4acd-83de-4cb2a3c9578f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:40.167931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dab79-9c18-4acd-83de-4cb2a3c9578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:40.187710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-863dab79-9c18-4acd-83de-4cb2a3c9578f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:40.188934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-863dab79-9c18-4acd-83de-4cb2a3c9578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:40.197362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1048/2106] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:40.220145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:40.230990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66579740-b605-427f-929a-2c68b50a6dbb service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:40.236320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00597-818a-44e9-b746-7fc591be0ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:40.236933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00597-818a-44e9-b746-7fc591be0ef5 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:40.237208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00597-818a-44e9-b746-7fc591be0ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:40.237981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00597-818a-44e9-b746-7fc591be0ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:40.245783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00597-818a-44e9-b746-7fc591be0ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:40.247335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00597-818a-44e9-b746-7fc591be0ef5 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:40.257079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1059/2107] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:50.182567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=33 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:50.252798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=44 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:57.501167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e21db-3ac7-43f0-b31f-d48d312f334b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:57.501678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e21db-3ac7-43f0-b31f-d48d312f334b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:57.501786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e21db-3ac7-43f0-b31f-d48d312f334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:57.521815 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-380e21db-3ac7-43f0-b31f-d48d312f334b None None] MFA Rules not processed for user `a59b5a57dac1419badb2d7b2d3fea4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:57.523022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-380e21db-3ac7-43f0-b31f-d48d312f334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:57.576453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1049/2108] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:07.569966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=25 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:07.714332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10a431-e2d1-4b68-a494-19b60b1d8bf3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:07.714849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10a431-e2d1-4b68-a494-19b60b1d8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:07.714970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10a431-e2d1-4b68-a494-19b60b1d8bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:07.734327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5a10a431-e2d1-4b68-a494-19b60b1d8bf3 None None] MFA Rules not processed for user `f83067d716e74d69bdffadb7e6c2ff6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:07.736163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5a10a431-e2d1-4b68-a494-19b60b1d8bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:07.790109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1060/2109] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:17.471565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0598dc-07ad-4a33-810f-ef7e8d187352 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:17.472112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0598dc-07ad-4a33-810f-ef7e8d187352 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:17.472112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0598dc-07ad-4a33-810f-ef7e8d187352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:17.497541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3b0598dc-07ad-4a33-810f-ef7e8d187352 None None] MFA Rules not processed for user `25492b6965e3422da9e28309b1b8347f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:17.498754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3b0598dc-07ad-4a33-810f-ef7e8d187352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:17.557226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1050/2110] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:17.783287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=25 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:18.593728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795066-7cbb-4e6d-a74f-dbb4ef7fe822 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:18.594019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795066-7cbb-4e6d-a74f-dbb4ef7fe822 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:18.594353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795066-7cbb-4e6d-a74f-dbb4ef7fe822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:18.615102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3a795066-7cbb-4e6d-a74f-dbb4ef7fe822 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:18.616356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3a795066-7cbb-4e6d-a74f-dbb4ef7fe822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:18.624175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1061/2111] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:18.645956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0598dc-07ad-4a33-810f-ef7e8d187352 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:18.660993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0598dc-07ad-4a33-810f-ef7e8d187352 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:18.666428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:18.667065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:18.667352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:18.667624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:18.676078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:18.677978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:18.689205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1051/2112] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:21.912987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66a4d-0a5a-4bdd-9778-c4471d0d2582 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:21.913520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66a4d-0a5a-4bdd-9778-c4471d0d2582 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:21.913520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66a4d-0a5a-4bdd-9778-c4471d0d2582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:21.933699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-79a66a4d-0a5a-4bdd-9778-c4471d0d2582 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:21.934833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-79a66a4d-0a5a-4bdd-9778-c4471d0d2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:21.942699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1062/2113] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:21.968442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:21.981371 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5f7a9-40d4-40de-b1aa-9f85908ba89c service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:21.988040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:21.988686 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:21.988968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:21.989239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:21.998483 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:22.000424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:22.010450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1052/2114] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:26.024082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e18948-c264-4d37-8c8f-34cd91c9eaad None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:26.024680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e18948-c264-4d37-8c8f-34cd91c9eaad None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:26.024680 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e18948-c264-4d37-8c8f-34cd91c9eaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:26.051921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-41e18948-c264-4d37-8c8f-34cd91c9eaad None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:26.053275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41e18948-c264-4d37-8c8f-34cd91c9eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:26.062620 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1063/2115] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:26.084422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:26.096286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e01613-c945-4acf-8fae-e5f6e6dd8505 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:26.103166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:26.103780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:26.104098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:26.104521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:26.113881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:26.115478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:26.125904 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1053/2116] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:29.157540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137000-8a25-45f0-926f-7c7145133814 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:29.158103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137000-8a25-45f0-926f-7c7145133814 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:29.158103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39137000-8a25-45f0-926f-7c7145133814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:29.177060 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-39137000-8a25-45f0-926f-7c7145133814 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:29.178243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-39137000-8a25-45f0-926f-7c7145133814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:29.187232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1064/2117] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:29.211998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:29.222991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed6b20-b12a-42c3-941e-09e782539329 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:29.228468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:29.229049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:29.229361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:29.229637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:29.237610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:29.239234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:29.249212 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1054/2118] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:33.379535 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:33.380109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:33.380109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:33.399321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:33.400546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:33.408407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1065/2119] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Oct 12 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:33.432473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:33.444278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc2388-d8b7-40df-b051-bae13ad683c4 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:33.449993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b120-b2dd-46c7-bc82-0e5362fd10cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:33.450591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b120-b2dd-46c7-bc82-0e5362fd10cf service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:33.450875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b120-b2dd-46c7-bc82-0e5362fd10cf service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:33.451266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b120-b2dd-46c7-bc82-0e5362fd10cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:33.459835 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b120-b2dd-46c7-bc82-0e5362fd10cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:33.461349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b120-b2dd-46c7-bc82-0e5362fd10cf service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:33.470646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1055/2120] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:43.394385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=15 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:43.466437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=55 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:48.068095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:48.069559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:48.126608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898f71-669e-4f68-bb0d-f1de31514de7 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:48.130264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:48.130865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:48.131174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:48.131444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:48.133164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:48.147211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:48.148662 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:48.159528 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1066/2121] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:48.291476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e945c-0d5e-4fe8-8bcd-61d96a99e9d0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:48.292029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e945c-0d5e-4fe8-8bcd-61d96a99e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:48.292029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e945c-0d5e-4fe8-8bcd-61d96a99e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:48.311616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9b8e945c-0d5e-4fe8-8bcd-61d96a99e9d0 None None] MFA Rules not processed for user `909a8fb02bf8468a9914e78b23c8ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:48.312787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9b8e945c-0d5e-4fe8-8bcd-61d96a99e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:48.320777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1056/2122] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:33:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:52.374278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:52.387174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee231-0d53-423b-bd1c-170e2d02a149 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:52.391712 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:52.392498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:52.392780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:52.393050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:52.394809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:52.410443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:52.411954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:52.424107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1067/2123] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:58.306173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:01.197930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1f90-38e7-4396-a836-1f6b3ba5b987 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:01.198535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1f90-38e7-4396-a836-1f6b3ba5b987 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:01.198535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1f90-38e7-4396-a836-1f6b3ba5b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:01.217899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cc9e1f90-38e7-4396-a836-1f6b3ba5b987 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:01.219101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cc9e1f90-38e7-4396-a836-1f6b3ba5b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:01.276437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1057/2124] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 12 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:01.322468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:01.323898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:01.390198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fafc17-8d75-4bc5-b5db-4955d8eccb72 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:01.395344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe2143-6cbd-48cc-ba23-580877068d6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:01.395970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2143-6cbd-48cc-ba23-580877068d6d service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:01.396251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2143-6cbd-48cc-ba23-580877068d6d service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:01.396525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2143-6cbd-48cc-ba23-580877068d6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:01.404350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe2143-6cbd-48cc-ba23-580877068d6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:01.405949 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe2143-6cbd-48cc-ba23-580877068d6d service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:01.414405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1068/2125] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:34:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:34:06.520557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a087-1588-4987-a148-d4365ec82986 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:06.521071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a087-1588-4987-a148-d4365ec82986 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:06.521270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a087-1588-4987-a148-d4365ec82986 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:06.522437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1058/2126] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:06.533911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:06.534428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:06.534428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:06.559278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] MFA Rules not processed for user `48cdf9ded77746a793b76d2df4940d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:06.562517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:06.645493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1069/2127] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:06.671376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a087-1588-4987-a148-d4365ec82986 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:06.674461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a852a087-1588-4987-a148-d4365ec82986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:06.683489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:06.685092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:06.713453 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41882c7c-cfd3-4d31-b7e4-7d86a6bfe407 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:06.713777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a087-1588-4987-a148-d4365ec82986 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:06.720708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:06.721717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:06.722087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:06.722265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:06.722618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] PATH_INFO: `/v3/users/a59b5a57dac1419badb2d7b2d3fea4e6` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:06.723849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:06.724218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59b5a57dac1419badb2d7b2d3fea4e6)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:06.724593 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:06.725020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:06.727104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:06.735995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:06.737929 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:06.745964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:06.752122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1059/2128] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:06.812559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59b5a57dac1419badb2d7b2d3fea4e6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:06.813402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59b5a57dac1419badb2d7b2d3fea4e6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:06.829105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59b5a57dac1419badb2d7b2d3fea4e6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:06.830080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59b5a57dac1419badb2d7b2d3fea4e6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:06.840204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59b5a57dac1419badb2d7b2d3fea4e6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:06.856435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1070/2129] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:34:06 2022] DELETE /identity/v3/users/a59b5a57dac1419badb2d7b2d3fea4e6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:07.058712 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:07.084803 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e8a87-bddc-4468-97de-27d077b63ff0 service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:07.168885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:07.169573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:07.169890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:07.170144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] PATH_INFO: `/v3/projects/a8e54a6aa6a3451bb7aa7c00c26a86bc` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:07.171281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e54a6aa6a3451bb7aa7c00c26a86bc)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:07.173458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:07.234076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e54a6aa6a3451bb7aa7c00c26a86bc', 'request_id': 'req-1242e0cc-e704-4b02-bc7f-baac186b797a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:07.243471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e54a6aa6a3451bb7aa7c00c26a86bc', 'request_id': 'req-1242e0cc-e704-4b02-bc7f-baac186b797a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:07.252412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e54a6aa6a3451bb7aa7c00c26a86bc', 'request_id': 'req-1242e0cc-e704-4b02-bc7f-baac186b797a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:07.265965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] The token cache is being invalidate because project a8e54a6aa6a3451bb7aa7c00c26a86bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:34:07.266850 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:07.267586 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:07.275919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1060/2130] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:34:07 2022] DELETE /identity/v3/projects/a8e54a6aa6a3451bb7aa7c00c26a86bc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:08.884757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:08.886297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:08.889799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:08.891331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:08.902256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05edbb-1402-40bc-a46c-da42b0169920 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:08.919646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:08.962552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:08.963105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:08.963389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:08.963665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] PATH_INFO: `/v3/users/eb24425427174fc7b6da943abc25a419` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:08.964878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb24425427174fc7b6da943abc25a419)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:08.966882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:08.970663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242e0cc-e704-4b02-bc7f-baac186b797a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:08.976245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:08.976851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:08.977156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:08.977431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:08.979589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:09.019080 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb24425427174fc7b6da943abc25a419'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.019745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb24425427174fc7b6da943abc25a419'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.033674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb24425427174fc7b6da943abc25a419'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.034311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb24425427174fc7b6da943abc25a419'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.042388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb24425427174fc7b6da943abc25a419'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.043191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:09.045668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:09.055962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1061/2131] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:34:09.056152 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1071/2132] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:34:08 2022] DELETE /identity/v3/users/eb24425427174fc7b6da943abc25a419 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:09.240059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:09.241516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:09.257496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98565b6-7044-418f-9e1a-1e6c5a751917 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:09.320448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:09.321111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:09.321367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:09.321644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] PATH_INFO: `/v3/projects/00932be8bff24f37a155f523154f930a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:09.322769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00932be8bff24f37a155f523154f930a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:09.324785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:09.380360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00932be8bff24f37a155f523154f930a', 'request_id': 'req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.389511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00932be8bff24f37a155f523154f930a', 'request_id': 'req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.395027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:09.397991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00932be8bff24f37a155f523154f930a', 'request_id': 'req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.414006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] The token cache is being invalidate because project 00932be8bff24f37a155f523154f930a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:34:09.414300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.414966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.416542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1062/2133] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:34:09 2022] DELETE /identity/v3/projects/00932be8bff24f37a155f523154f930a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:09.420589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:09.421986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:09.436163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729bb6-4232-42f9-8e37-88a439288f68 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:09.441562 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:09.498074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:09.498697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:09.498979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:09.499255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] PATH_INFO: `/v3/users/fac420361f3c42dfabd078f13716d690` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:09.500398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac420361f3c42dfabd078f13716d690)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:09.502306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:09.547114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac420361f3c42dfabd078f13716d690'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.547781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac420361f3c42dfabd078f13716d690'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.559669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac420361f3c42dfabd078f13716d690'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.560231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac420361f3c42dfabd078f13716d690'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.567127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac420361f3c42dfabd078f13716d690'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.579602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1072/2134] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:34:09 2022] DELETE /identity/v3/users/fac420361f3c42dfabd078f13716d690 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:09.749066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:09.750506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:09.767880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee7dc-0494-44ee-aa41-6fff4d56b69f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:09.825395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:09.826021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:09.826300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:09.826570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] PATH_INFO: `/v3/projects/197aeee1fe9d4c82a6f93c57f7fa1cf7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:09.827665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=197aeee1fe9d4c82a6f93c57f7fa1cf7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:09.830148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:09.877200 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197aeee1fe9d4c82a6f93c57f7fa1cf7', 'request_id': 'req-1dbfb286-be97-418d-b427-624903c65e9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.884634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197aeee1fe9d4c82a6f93c57f7fa1cf7', 'request_id': 'req-1dbfb286-be97-418d-b427-624903c65e9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.890235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197aeee1fe9d4c82a6f93c57f7fa1cf7', 'request_id': 'req-1dbfb286-be97-418d-b427-624903c65e9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.903392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] The token cache is being invalidate because project 197aeee1fe9d4c82a6f93c57f7fa1cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:34:09.904041 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.904734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:09.906226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1063/2135] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:34:09 2022] DELETE /identity/v3/projects/197aeee1fe9d4c82a6f93c57f7fa1cf7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:19.575533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:19.900357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=8,keystone:SELECT=55,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:23.897121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:23.898520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:23.971054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957164ad-c16f-4f49-95b6-96eb316af658 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:24.031512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2ffb-2c7b-40eb-9501-6e7709f82984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:24.032667 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2ffb-2c7b-40eb-9501-6e7709f82984 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:24.032950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2ffb-2c7b-40eb-9501-6e7709f82984 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:24.033221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2ffb-2c7b-40eb-9501-6e7709f82984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:24.034944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-044a2ffb-2c7b-40eb-9501-6e7709f82984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:24.093230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2ffb-2c7b-40eb-9501-6e7709f82984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:24.095343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2ffb-2c7b-40eb-9501-6e7709f82984 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:24.104506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1073/2136] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:34.100133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=84 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:34.916340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:34.918567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:34.935115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb286-be97-418d-b427-624903c65e9a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:34.941525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:34.942216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:34.942582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:34.942898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:34.945445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:34.958710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:34.961095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:34.974197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1064/2137] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:38.206016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:38.206531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:38.206656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:38.225644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:38.226841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:38.281908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1074/2138] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:38.294395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:38.295572 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:38.370258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7979-8194-4d57-b7d4-6075bf7e186f service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:38.375774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:38.376995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:38.377279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:38.377553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:38.389326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:38.391272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:38.401310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1065/2139] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:34:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:34:38.528069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:38.529501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:38.630972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8480e41-65c1-408b-9170-5d6aef780422 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:38.648530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997c1aa-6bf8-4d63-8efb-1028382cc42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:38.649395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c1aa-6bf8-4d63-8efb-1028382cc42a service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:38.650373 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c1aa-6bf8-4d63-8efb-1028382cc42a service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:38.650744 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c1aa-6bf8-4d63-8efb-1028382cc42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:38.656904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9997c1aa-6bf8-4d63-8efb-1028382cc42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:38.673044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997c1aa-6bf8-4d63-8efb-1028382cc42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:38.675334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997c1aa-6bf8-4d63-8efb-1028382cc42a service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:38.685361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1075/2140] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:40.493250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:40.494680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:40.525778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6fc8-342e-4b6a-a352-769b1a7ad1e2 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:40.534637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb76ff-93bc-416f-a28a-4f1a1e8f2c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:40.535468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb76ff-93bc-416f-a28a-4f1a1e8f2c66 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:40.535995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb76ff-93bc-416f-a28a-4f1a1e8f2c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:40.540119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb76ff-93bc-416f-a28a-4f1a1e8f2c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:40.544930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a4fb76ff-93bc-416f-a28a-4f1a1e8f2c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:40.590600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb76ff-93bc-416f-a28a-4f1a1e8f2c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:40.592258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb76ff-93bc-416f-a28a-4f1a1e8f2c66 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:40.615123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1066/2141] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:46.516143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeca8e-e5ae-4e36-a9b7-d2044d628244 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:46.516611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeca8e-e5ae-4e36-a9b7-d2044d628244 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:46.516611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeca8e-e5ae-4e36-a9b7-d2044d628244 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:46.518546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1076/2142] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:46.532729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492273-89a2-44f5-af19-99362abfb24c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:46.533257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492273-89a2-44f5-af19-99362abfb24c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:46.533257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492273-89a2-44f5-af19-99362abfb24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:46.566179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-36492273-89a2-44f5-af19-99362abfb24c None None] MFA Rules not processed for user `319b5538054c49d19ecc0b9c9cfc5b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:46.567441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36492273-89a2-44f5-af19-99362abfb24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:46.597106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1067/2143] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:34:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:46.626011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeca8e-e5ae-4e36-a9b7-d2044d628244 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:46.628393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5bdeca8e-e5ae-4e36-a9b7-d2044d628244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:46.659488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeca8e-e5ae-4e36-a9b7-d2044d628244 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:46.669615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8939e8-5dcf-45e9-8565-0af6a7132905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:46.670241 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8939e8-5dcf-45e9-8565-0af6a7132905 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:46.670519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8939e8-5dcf-45e9-8565-0af6a7132905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:46.670787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8939e8-5dcf-45e9-8565-0af6a7132905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:46.696095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8939e8-5dcf-45e9-8565-0af6a7132905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:46.697618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8939e8-5dcf-45e9-8565-0af6a7132905 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:46.727222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1077/2144] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:46.896429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a100b-102b-4ba9-89e1-ee1026f8256c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:46.897240 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a100b-102b-4ba9-89e1-ee1026f8256c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:46.897782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a100b-102b-4ba9-89e1-ee1026f8256c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:46.899478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1068/2145] 10.222.0.45 () {54 vars in 921 bytes} [Wed Oct 12 12:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:46.908288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:46.908571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:46.909077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:46.948160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] MFA Rules not processed for user `c01495a37066445293bdb957ece67e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:46.949962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:46.968403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1078/2146] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Oct 12 12:34:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:46.982782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a100b-102b-4ba9-89e1-ee1026f8256c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:47.004606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a100b-102b-4ba9-89e1-ee1026f8256c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:47.010556 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:47.011860 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:47.012409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:47.012838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:47.031428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:47.033280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:47.058237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1069/2147] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:47.181751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:47.183866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:47.348306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0997d-1a56-4648-82f1-6eedc0cf8fdb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:47.354533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:47.355248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:47.355567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:47.356050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:47.357982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:47.384962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:47.386568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:47.416166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1079/2148] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:51.977196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:51.985798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f03a5-f390-429a-9dc6-c8f82a9c7f2d service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:51.989409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:51.989993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:51.990274 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:51.990546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:51.992267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:52.053713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:52.055059 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:52.064988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1070/2149] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:56.296174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:56.299094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:56.314815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c884c1-b90a-4624-9a71-8874039924bb service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:56.319777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:56.320499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.320854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.321200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] PATH_INFO: `/v3/users/25492b6965e3422da9e28309b1b8347f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.322403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25492b6965e3422da9e28309b1b8347f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:56.324456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:56.337275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:56.383506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25492b6965e3422da9e28309b1b8347f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.384216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25492b6965e3422da9e28309b1b8347f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.396145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25492b6965e3422da9e28309b1b8347f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.396797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25492b6965e3422da9e28309b1b8347f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.404312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec1a2cb0-be16-4ef6-98bc-d387db5f58c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25492b6965e3422da9e28309b1b8347f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.416901 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1080/2150] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:34:56 2022] DELETE /identity/v3/users/25492b6965e3422da9e28309b1b8347f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:56.596579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:56.616891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce817-3e46-43fe-9c8f-944ecb3b3f07 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:56.657590 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:56.683876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:56.684783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.685065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.685368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] PATH_INFO: `/v3/projects/1ef2e209a20b454f89b5a6e1193fe45b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.686490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef2e209a20b454f89b5a6e1193fe45b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:56.688557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:56.737007 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef2e209a20b454f89b5a6e1193fe45b', 'request_id': 'req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.745744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef2e209a20b454f89b5a6e1193fe45b', 'request_id': 'req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.751840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef2e209a20b454f89b5a6e1193fe45b', 'request_id': 'req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.763125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] The token cache is being invalidate because project 1ef2e209a20b454f89b5a6e1193fe45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:34:56.763415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.764094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0b7101d5-627f-48b3-a29a-5ba1a8d70f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:34:56.765568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1071/2151] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:34:56 2022] DELETE /identity/v3/projects/1ef2e209a20b454f89b5a6e1193fe45b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:56.771055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56bec2-3e8c-4690-98af-5d4b5ff2e6ac None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.771347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56bec2-3e8c-4690-98af-5d4b5ff2e6ac None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.771617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56bec2-3e8c-4690-98af-5d4b5ff2e6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.791854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ef56bec2-3e8c-4690-98af-5d4b5ff2e6ac None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:56.793058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ef56bec2-3e8c-4690-98af-5d4b5ff2e6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:56.855865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1081/2152] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:56.863530 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8eeda-e3d0-4482-b2e9-f9c887112d8d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.863966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8eeda-e3d0-4482-b2e9-f9c887112d8d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.864312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8eeda-e3d0-4482-b2e9-f9c887112d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.885945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0ac8eeda-e3d0-4482-b2e9-f9c887112d8d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:56.887028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0ac8eeda-e3d0-4482-b2e9-f9c887112d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:56.897762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1072/2153] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:56.902643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56bec2-3e8c-4690-98af-5d4b5ff2e6ac None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:56.914536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56bec2-3e8c-4690-98af-5d4b5ff2e6ac None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:56.920372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:56.921177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.921395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.921742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.922730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:34:56.922844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:56.924523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:56.938264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1082/2154] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:34:56.943438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8eeda-e3d0-4482-b2e9-f9c887112d8d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:56.953309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8eeda-e3d0-4482-b2e9-f9c887112d8d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:56.959834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:56.960469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.960756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.961029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.961666 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:56.963641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:57.001020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1073/2155] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:34:56 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:34:57.008017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:57.023580 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a61e27-b537-42f2-87d6-9731d60948aa admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:57.102855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:57.103376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:57.103652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:57.103959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:57.104606 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:57.106499 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:57.128003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1083/2156] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:34:57 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:34:57.132278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:57.143538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0208b21-9aa0-4375-bc48-931d6a2f44a3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:57.148205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:57.148799 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:57.149082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:57.149357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:57.149996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:57.151589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:57.161426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1074/2157] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:34:57.165411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:57.175630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f834f6-e006-4fa3-82b5-20a81b7e5b7f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:57.180375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75f68b-a96f-461e-b45b-7f83398260b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:57.180970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75f68b-a96f-461e-b45b-7f83398260b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:57.181253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75f68b-a96f-461e-b45b-7f83398260b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:57.181534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75f68b-a96f-461e-b45b-7f83398260b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:57.182207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75f68b-a96f-461e-b45b-7f83398260b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:57.183808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75f68b-a96f-461e-b45b-7f83398260b7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:57.185354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:57.197053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1084/2158] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:34:57.201054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:57.211027 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb520c-bb0d-4f6a-ac56-7a18947b01c0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:57.215598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:57.216265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:57.216547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:57.216822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] PATH_INFO: `/v3/projects/97f9cef0bcf14eae967f273861a93e54/users/4e93a358d9a1427288d43e7449fd8624/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:57.231069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f9cef0bcf14eae967f273861a93e54, user_id=4e93a358d9a1427288d43e7449fd8624, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:57.233716 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:57.247783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1075/2159] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:34:57 2022] PUT /identity/v3/projects/97f9cef0bcf14eae967f273861a93e54/users/4e93a358d9a1427288d43e7449fd8624/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:34:57.259603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf35a4d-5fec-4560-b878-90de12306f6f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:57.259918 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf35a4d-5fec-4560-b878-90de12306f6f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:57.260190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf35a4d-5fec-4560-b878-90de12306f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:57.286755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-faf35a4d-5fec-4560-b878-90de12306f6f None None] MFA Rules not processed for user `4e93a358d9a1427288d43e7449fd8624`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:57.287991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-faf35a4d-5fec-4560-b878-90de12306f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:57.354934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1085/2160] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:34:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:57.366068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:57.367763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:57.460739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:57.478006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfde234-2396-4b0d-a067-9a9ea63f7062 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:57.497481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36fb0-73aa-417d-99e7-2a95346c2b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:57.499159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36fb0-73aa-417d-99e7-2a95346c2b78 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:57.499547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36fb0-73aa-417d-99e7-2a95346c2b78 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:57.499971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36fb0-73aa-417d-99e7-2a95346c2b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:57.512400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36fb0-73aa-417d-99e7-2a95346c2b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:57.514516 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36fb0-73aa-417d-99e7-2a95346c2b78 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:57.526652 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1076/2161] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:00.329142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf35a4d-5fec-4560-b878-90de12306f6f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:00.386781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf35a4d-5fec-4560-b878-90de12306f6f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:00.391204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:00.391838 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:00.392628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:00.392894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] PATH_INFO: `/v3/users/4e93a358d9a1427288d43e7449fd8624` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:00.393990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e93a358d9a1427288d43e7449fd8624)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:00.395907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:00.439644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e93a358d9a1427288d43e7449fd8624'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:00.440315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e93a358d9a1427288d43e7449fd8624'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:00.452146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e93a358d9a1427288d43e7449fd8624'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:00.452777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e93a358d9a1427288d43e7449fd8624'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:00.460427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e93a358d9a1427288d43e7449fd8624'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:00.472965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1086/2162] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:00 2022] DELETE /identity/v3/users/4e93a358d9a1427288d43e7449fd8624 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:00.477562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:00.478083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:00.478206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:00.502600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:00.503868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:00.565456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1077/2163] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:00.575226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:00.576789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:00.583939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:00.638569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d064d-352f-4835-bccd-7068fbec901e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:00.642777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a0b87-527e-41a7-b045-08df3800e0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:00.643384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0b87-527e-41a7-b045-08df3800e0ac service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:00.643681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0b87-527e-41a7-b045-08df3800e0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:00.643968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0b87-527e-41a7-b045-08df3800e0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:00.652867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a0b87-527e-41a7-b045-08df3800e0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:00.654287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a0b87-527e-41a7-b045-08df3800e0ac service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:00.663564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1087/2164] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:00.929866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:00.931286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:00.944063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011216b-f3f9-4e8f-9b39-ccd1bf05edc4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:00.949463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:00.950120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:00.950402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:00.950677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] PATH_INFO: `/v3/projects/97f9cef0bcf14eae967f273861a93e54` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:00.951812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f9cef0bcf14eae967f273861a93e54)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:00.953744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:00.999553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f9cef0bcf14eae967f273861a93e54', 'request_id': 'req-9233616a-c229-42ec-9feb-182c93b6e79e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:01.008217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f9cef0bcf14eae967f273861a93e54', 'request_id': 'req-9233616a-c229-42ec-9feb-182c93b6e79e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:01.013713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f9cef0bcf14eae967f273861a93e54', 'request_id': 'req-9233616a-c229-42ec-9feb-182c93b6e79e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:01.024562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] The token cache is being invalidate because project 97f9cef0bcf14eae967f273861a93e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:01.024848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:01.025469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9233616a-c229-42ec-9feb-182c93b6e79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:01.026935 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1078/2165] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:00 2022] DELETE /identity/v3/projects/97f9cef0bcf14eae967f273861a93e54 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:01.032285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1168-ba7f-4c05-9e97-28073f6d8744 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.032670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1168-ba7f-4c05-9e97-28073f6d8744 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.033006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1168-ba7f-4c05-9e97-28073f6d8744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.053479 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-079e1168-ba7f-4c05-9e97-28073f6d8744 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:01.054660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-079e1168-ba7f-4c05-9e97-28073f6d8744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:01.111369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1088/2166] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:01.118964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56802-62cc-4af0-95bc-99de0feb127d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.119252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56802-62cc-4af0-95bc-99de0feb127d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.119532 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56802-62cc-4af0-95bc-99de0feb127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.139380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ddd56802-62cc-4af0-95bc-99de0feb127d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:01.140607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ddd56802-62cc-4af0-95bc-99de0feb127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:01.148346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1079/2167] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:01.152247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1168-ba7f-4c05-9e97-28073f6d8744 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:01.161539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1168-ba7f-4c05-9e97-28073f6d8744 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:01.166079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.166665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.166942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.167215 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.167882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:01.168207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.170235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.182371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1089/2168] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:01.186898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd56802-62cc-4af0-95bc-99de0feb127d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:01.196576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd56802-62cc-4af0-95bc-99de0feb127d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:01.203006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.203620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.203941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.204930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.205675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.207604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.239208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1080/2169] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:01 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:01.240340 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:01.250346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1e764-0666-434f-95ef-2e74cca0c56b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:01.311397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.312387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.312730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.312977 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.313705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.316436 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.350752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1090/2170] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:01 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:01.353113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:01.364932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070c1c-e0c1-47d9-918a-ed04d758a223 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:01.369468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.370069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.370349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.370619 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.371257 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.372874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.382927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1081/2171] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:01.387089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:01.397020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d095-aaed-4da5-a0a6-323082cb5d97 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:01.401682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b23ed-e384-4b9c-8e4e-63e37f222861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.402317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b23ed-e384-4b9c-8e4e-63e37f222861 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.402605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b23ed-e384-4b9c-8e4e-63e37f222861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.402867 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b23ed-e384-4b9c-8e4e-63e37f222861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.403510 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b23ed-e384-4b9c-8e4e-63e37f222861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.405178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b23ed-e384-4b9c-8e4e-63e37f222861 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.416321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1091/2172] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:01.420479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:01.431149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43831e8d-dc41-4c33-8101-65c7c06a0d75 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:01.436879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.437560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.437847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.438121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] PATH_INFO: `/v3/projects/c970719691fa4b5aa5e3a24d042dacd0/users/418135895e7445d397c34b8d7cbec192/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.452899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c970719691fa4b5aa5e3a24d042dacd0, user_id=418135895e7445d397c34b8d7cbec192, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.455562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.469576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1082/2173] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:01 2022] PUT /identity/v3/projects/c970719691fa4b5aa5e3a24d042dacd0/users/418135895e7445d397c34b8d7cbec192/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:01.480498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148850a1-35fa-41f8-a600-d6d90137442c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.480817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148850a1-35fa-41f8-a600-d6d90137442c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.481095 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148850a1-35fa-41f8-a600-d6d90137442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.506098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:01.509046 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-148850a1-35fa-41f8-a600-d6d90137442c None None] MFA Rules not processed for user `418135895e7445d397c34b8d7cbec192`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:01.510915 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-148850a1-35fa-41f8-a600-d6d90137442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:01.574133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1092/2174] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:01.584838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:01.586525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:01.597843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:01.645913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5143724-4941-4fe3-8e2f-a9dbe0e19f92 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:01.649648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.650318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.650861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.651261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.660538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.661996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.670879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1083/2175] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:05.502659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:05.503161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:05.503348 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:05.523065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:05.524304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:05.577598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1093/2176] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Oct 12 12:35:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:05.600170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:05.601557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:05.671854 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed1e9a-08cf-472b-a261-ee0fa5f9059b service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:05.676901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:05.677497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:05.677778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:05.678052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:05.686095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:05.687661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:05.695559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1084/2177] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:35:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:35:06.008925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:06.011032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:06.162713 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae916cf-e4fb-4058-90f6-7c2464a41a08 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:06.173066 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3805b1-466d-4747-a004-0f63e19adfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:06.174335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3805b1-466d-4747-a004-0f63e19adfde service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:06.174634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3805b1-466d-4747-a004-0f63e19adfde service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:06.175055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3805b1-466d-4747-a004-0f63e19adfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:06.176805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0b3805b1-466d-4747-a004-0f63e19adfde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:06.312904 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3805b1-466d-4747-a004-0f63e19adfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:06.315973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3805b1-466d-4747-a004-0f63e19adfde service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:06.333346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:06.347622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1094/2178] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:10.803310 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:10.820845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdd30b-ec10-4643-b720-a1bdc5b986bd service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:10.826029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:10.826661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:10.826944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:10.827351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] PATH_INFO: `/v3/users/418135895e7445d397c34b8d7cbec192` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:10.829084 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=418135895e7445d397c34b8d7cbec192)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:10.834578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:10.960928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418135895e7445d397c34b8d7cbec192'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:10.961991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418135895e7445d397c34b8d7cbec192'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:10.978107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418135895e7445d397c34b8d7cbec192'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:10.978861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418135895e7445d397c34b8d7cbec192'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:11.002832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418135895e7445d397c34b8d7cbec192'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:11.028848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1085/2179] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:10 2022] DELETE /identity/v3/users/418135895e7445d397c34b8d7cbec192 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:11.031144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:11.031656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:11.032124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:11.060900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:11.063728 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:11.158725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:11.160967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:11.189329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:11.240997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1095/2180] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:11.251750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:11.254598 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:11.303618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e674-9980-4cdf-94fe-8d46da0ca92f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:11.309031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:11.310260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:11.310553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:11.310846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] PATH_INFO: `/v3/users/909a8fb02bf8468a9914e78b23c8ea42` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:11.315966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=909a8fb02bf8468a9914e78b23c8ea42)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:11.317927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:11.400034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909a8fb02bf8468a9914e78b23c8ea42'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:11.402605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909a8fb02bf8468a9914e78b23c8ea42'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:11.412160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a5d0-1ff8-4e51-bcb4-a23b61f6c7ae None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:11.415400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909a8fb02bf8468a9914e78b23c8ea42'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:11.417674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909a8fb02bf8468a9914e78b23c8ea42'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:11.421663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a1c96-c554-4af9-9b04-d8714e9fdfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:11.422253 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1c96-c554-4af9-9b04-d8714e9fdfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:11.422533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1c96-c554-4af9-9b04-d8714e9fdfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:11.422807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1c96-c554-4af9-9b04-d8714e9fdfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:11.429071 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-704a1c96-c554-4af9-9b04-d8714e9fdfb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:11.445949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909a8fb02bf8468a9914e78b23c8ea42'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:11.458154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a1c96-c554-4af9-9b04-d8714e9fdfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:11.459687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a1c96-c554-4af9-9b04-d8714e9fdfb6 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:11.474928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1086/2181] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:11 2022] DELETE /identity/v3/users/909a8fb02bf8468a9914e78b23c8ea42 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:11.480394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1096/2182] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:11.781076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:11.784061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:11.887180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590a9b-c860-4505-b2d6-42ab5e5073bf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:11.900208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:11.901481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:11.902071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:11.902644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] PATH_INFO: `/v3/projects/b5e74fd8e66643109e9487d1b71e91c1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:11.905334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e74fd8e66643109e9487d1b71e91c1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:11.907466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:11.992889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:12.024836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e74fd8e66643109e9487d1b71e91c1', 'request_id': 'req-9d0093af-e323-4ace-9099-e6849e99a023'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.042879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e74fd8e66643109e9487d1b71e91c1', 'request_id': 'req-9d0093af-e323-4ace-9099-e6849e99a023'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.055040 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e74fd8e66643109e9487d1b71e91c1', 'request_id': 'req-9d0093af-e323-4ace-9099-e6849e99a023'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.081725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] The token cache is being invalidate because project b5e74fd8e66643109e9487d1b71e91c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:12.082029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.084216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.086153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1087/2183] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:11 2022] DELETE /identity/v3/projects/b5e74fd8e66643109e9487d1b71e91c1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:12.091169 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887605-6c7c-40e4-8b5f-e2d56a5e360a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.091716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887605-6c7c-40e4-8b5f-e2d56a5e360a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.091848 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887605-6c7c-40e4-8b5f-e2d56a5e360a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.123297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-05887605-6c7c-40e4-8b5f-e2d56a5e360a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:12.124854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-05887605-6c7c-40e4-8b5f-e2d56a5e360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.215460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.217724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.230171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1097/2184] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:12.239525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef8a1-2f09-41da-a5ce-06c39b142363 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.239929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef8a1-2f09-41da-a5ce-06c39b142363 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.240274 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef8a1-2f09-41da-a5ce-06c39b142363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.262919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e93ef8a1-2f09-41da-a5ce-06c39b142363 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:12.264196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e93ef8a1-2f09-41da-a5ce-06c39b142363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.272875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1098/2185] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:12.276866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef8a1-2f09-41da-a5ce-06c39b142363 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.289490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef8a1-2f09-41da-a5ce-06c39b142363 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.295036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.295700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.295983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.296261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.296986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:12.297298 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.299605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.317679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1099/2186] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:12.322079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.334697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36ce2b-2450-46fd-86a6-de4f5edf893d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.340840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.341672 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.341967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.342324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.342981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.344999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.370713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0093af-e323-4ace-9099-e6849e99a023 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.375631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:12.381215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.382098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.382804 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.383978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] PATH_INFO: `/v3/projects/c970719691fa4b5aa5e3a24d042dacd0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.385920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c970719691fa4b5aa5e3a24d042dacd0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.388440 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.390428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1100/2187] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:12.394434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.460628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c970719691fa4b5aa5e3a24d042dacd0', 'request_id': 'req-e5e57a2b-e169-48e8-8571-81460614e984'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.469465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c970719691fa4b5aa5e3a24d042dacd0', 'request_id': 'req-e5e57a2b-e169-48e8-8571-81460614e984'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.475956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c970719691fa4b5aa5e3a24d042dacd0', 'request_id': 'req-e5e57a2b-e169-48e8-8571-81460614e984'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.488369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d406991-5c5a-4a31-a918-be114a6563dd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.491148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] The token cache is being invalidate because project c970719691fa4b5aa5e3a24d042dacd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:12.491503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.492331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e5e57a2b-e169-48e8-8571-81460614e984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:12.494155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1088/2188] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:12 2022] DELETE /identity/v3/projects/c970719691fa4b5aa5e3a24d042dacd0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:12.498688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41183-0585-47cf-a3bd-9a3e75fcaea6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.498974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41183-0585-47cf-a3bd-9a3e75fcaea6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.499256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41183-0585-47cf-a3bd-9a3e75fcaea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.521622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-95d41183-0585-47cf-a3bd-9a3e75fcaea6 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:12.522848 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-95d41183-0585-47cf-a3bd-9a3e75fcaea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.558144 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.558671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.558951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.559226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.560390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.562107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.584970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:12.594200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1101/2189] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:12.596096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.599899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.613429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1089/2190] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:12.616052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c15db-ab4e-4a0e-bca4-b23cb4b63338 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.621150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e916f-ce49-4692-85d9-9b4e7d3093c8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.621564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e916f-ce49-4692-85d9-9b4e7d3093c8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.621944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e916f-ce49-4692-85d9-9b4e7d3093c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.626805 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.627495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.627781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.628094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.628821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.630724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.646490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1102/2191] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:12.646795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fe7e916f-ce49-4692-85d9-9b4e7d3093c8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:12.647621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.648280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fe7e916f-ce49-4692-85d9-9b4e7d3093c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.661524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1090/2192] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:12.661745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136682-8f2f-4c68-af8a-803f39b61adc admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.663692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e916f-ce49-4692-85d9-9b4e7d3093c8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.671513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.672164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.672447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.672726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.674490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.676179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.682237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e916f-ce49-4692-85d9-9b4e7d3093c8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.690303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.691114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.691543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.692002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.692804 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:12.693228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.695658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.698882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1103/2193] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:12.704990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.710408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1091/2194] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:12.716147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da563f4-c263-4f67-b067-c685073a0878 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.716922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.722001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3cd76-bd65-415f-b071-665aec09b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.722785 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3cd76-bd65-415f-b071-665aec09b700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.723137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3cd76-bd65-415f-b071-665aec09b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.723507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3cd76-bd65-415f-b071-665aec09b700 admin admin] PATH_INFO: `/v3/projects/b422ec83a1e14931b4d759190e3cfd6d/users/55132062ad194d6bb0ade30c3538d4c5/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.734326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5f69-63ec-422b-b99b-f0132b0f2077 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.739993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.740616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.741123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.741258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.742129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.744655 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3cd76-bd65-415f-b071-665aec09b700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b422ec83a1e14931b4d759190e3cfd6d, user_id=55132062ad194d6bb0ade30c3538d4c5, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.744844 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.747651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3cd76-bd65-415f-b071-665aec09b700 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.774879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1104/2195] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:12 2022] PUT /identity/v3/projects/b422ec83a1e14931b4d759190e3cfd6d/users/55132062ad194d6bb0ade30c3538d4c5/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:12.781166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57db1fc-7428-4579-87bd-eb9a881fb97b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.782166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57db1fc-7428-4579-87bd-eb9a881fb97b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.783282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57db1fc-7428-4579-87bd-eb9a881fb97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.801446 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1092/2196] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:12.805492 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.833208 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a57db1fc-7428-4579-87bd-eb9a881fb97b None None] MFA Rules not processed for user `55132062ad194d6bb0ade30c3538d4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:12.834666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a57db1fc-7428-4579-87bd-eb9a881fb97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.894662 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:12.947778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816cc97-f23b-4789-8717-e471816cc13e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.967183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.968416 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.971010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.971779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.974279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1105/2197] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:12.975242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:12.978859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57db1fc-7428-4579-87bd-eb9a881fb97b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:12.979460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:12.993605 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57db1fc-7428-4579-87bd-eb9a881fb97b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:12.998964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:12.999681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.000006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.000277 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.008327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.010484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.016346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1093/2198] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:13.021291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.034879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346a5e1-0596-4400-940b-8a4edc3ddf65 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.041662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.042742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.043591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.044477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.046010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.050122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.064914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1094/2199] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:13.069421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1106/2200] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:13.070146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.073014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.088360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411ef3-6fbe-4dad-987e-86b6dbc6f4d9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.151323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56a08-911d-4172-9f65-926adfe713bb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.157312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.158947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.159040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.159398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.160339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.162364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.163485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.164135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.164421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.164693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.165344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.166961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.179971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1095/2201] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:13.183570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.186903 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1107/2202] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:13 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:13.191238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.196094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6ea3-3dd2-4713-9c7a-b4477790ad0c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.200934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab88a-c933-435a-8016-710af21c749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.201726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab88a-c933-435a-8016-710af21c749e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.202017 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab88a-c933-435a-8016-710af21c749e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.202292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab88a-c933-435a-8016-710af21c749e admin admin] PATH_INFO: `/v3/projects/0e0fe03f7f8d4c909649dbc48a29d257/users/c9b523c70b28483dbca86c9adc7f58f7/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.202435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd2aa-b08f-4bdc-ad74-79859da88672 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.207901 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.208543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.208836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.209104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.209779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.211448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.219579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab88a-c933-435a-8016-710af21c749e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0fe03f7f8d4c909649dbc48a29d257, user_id=c9b523c70b28483dbca86c9adc7f58f7, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.223327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab88a-c933-435a-8016-710af21c749e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.223473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1108/2203] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:13.227416 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.238457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bd1d9-8c52-4cce-ba84-c555ed4d1273 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.239051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1096/2204] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:13 2022] PUT /identity/v3/projects/0e0fe03f7f8d4c909649dbc48a29d257/users/c9b523c70b28483dbca86c9adc7f58f7/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:13.249591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.249881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.250158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.259122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:13.286127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] MFA Rules not processed for user `c9b523c70b28483dbca86c9adc7f58f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:13.288447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:13.298933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.299593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.299905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.300182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] PATH_INFO: `/v3/projects/013fea3e4c004f1ba2b55a1c79657fd9/users/30a0560778ca488bbc5fffec339ad1c8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.317247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=013fea3e4c004f1ba2b55a1c79657fd9, user_id=30a0560778ca488bbc5fffec339ad1c8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.319924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.335031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1109/2205] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:13 2022] PUT /identity/v3/projects/013fea3e4c004f1ba2b55a1c79657fd9/users/30a0560778ca488bbc5fffec339ad1c8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:13.338898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.355983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1097/2206] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:13.360379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:13.368880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.370436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:13.406957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4a62-a8d6-4f1c-96c9-7d5d98b151fb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.411726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.412360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.412665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.412925 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.413572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.415176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.425515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1110/2207] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:13.429364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.439421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba8df5-4387-4aec-b1aa-ff2feaf7e2b6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.444280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd73b-5c05-4038-a633-967291d19cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.444899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd73b-5c05-4038-a633-967291d19cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.445176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd73b-5c05-4038-a633-967291d19cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.445443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd73b-5c05-4038-a633-967291d19cb9 admin admin] PATH_INFO: `/v3/projects/013fea3e4c004f1ba2b55a1c79657fd9/users/30a0560778ca488bbc5fffec339ad1c8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.447358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd73b-5c05-4038-a633-967291d19cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013fea3e4c004f1ba2b55a1c79657fd9, user_id=30a0560778ca488bbc5fffec339ad1c8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.448012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664d04f-0e96-4640-a919-1ef841602098 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.450017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd73b-5c05-4038-a633-967291d19cb9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.460676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1111/2208] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:13 2022] PUT /identity/v3/projects/013fea3e4c004f1ba2b55a1c79657fd9/users/30a0560778ca488bbc5fffec339ad1c8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:13.470588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.470869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.471173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.499419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] MFA Rules not processed for user `30a0560778ca488bbc5fffec339ad1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:13.500687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:13.514380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.515024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.515306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.515613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.543104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:13.569961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1112/2209] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:13.574014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.575941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.581565 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.582911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:13.585581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1098/2210] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:13.650898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976665-3b37-400e-be05-d82eb3464d3d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.655346 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.655646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.655962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.656240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.665738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.667172 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.682607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1113/2211] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:13.768033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.769488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:13.800461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.833836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b318d57-7292-4d2e-860d-d326307148b9 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.835698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:13.837691 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a9e6d-1096-4241-b039-86244cf9fb23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.838337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9e6d-1096-4241-b039-86244cf9fb23 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.838697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9e6d-1096-4241-b039-86244cf9fb23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.838981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9e6d-1096-4241-b039-86244cf9fb23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.869588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d2d8-cf71-4684-b286-18aa1384579b service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.874143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.874759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.875042 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.875314 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] PATH_INFO: `/v3/users/c9b523c70b28483dbca86c9adc7f58f7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.876491 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b523c70b28483dbca86c9adc7f58f7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.878736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.896886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a9e6d-1096-4241-b039-86244cf9fb23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.898328 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a9e6d-1096-4241-b039-86244cf9fb23 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.908438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1099/2212] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:13.926392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b523c70b28483dbca86c9adc7f58f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:13.927056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b523c70b28483dbca86c9adc7f58f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:13.939555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b523c70b28483dbca86c9adc7f58f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:13.940317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b523c70b28483dbca86c9adc7f58f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:13.948408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b523c70b28483dbca86c9adc7f58f7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:13.961352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1114/2213] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:13 2022] DELETE /identity/v3/users/c9b523c70b28483dbca86c9adc7f58f7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:13.965926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.966425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.966536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.986955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:13.988239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:14.058267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1100/2214] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:14.068798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.070227 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:14.128773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205b3c3-5f54-4bf3-89c3-731dff75037c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.132332 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e990e-4c6c-4ba1-8a61-b4c71d9cc2e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.132943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e990e-4c6c-4ba1-8a61-b4c71d9cc2e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.133225 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e990e-4c6c-4ba1-8a61-b4c71d9cc2e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.133500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e990e-4c6c-4ba1-8a61-b4c71d9cc2e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.143338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e990e-4c6c-4ba1-8a61-b4c71d9cc2e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.144808 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e990e-4c6c-4ba1-8a61-b4c71d9cc2e5 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.154489 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1115/2215] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:14.416185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.417689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:14.430268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d74fb-d4ff-47a3-9d57-c10a69a0c31b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.435235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.435882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.436167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.436439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] PATH_INFO: `/v3/projects/0e0fe03f7f8d4c909649dbc48a29d257` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.437551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0fe03f7f8d4c909649dbc48a29d257)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.440186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.456792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:14.487585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0fe03f7f8d4c909649dbc48a29d257', 'request_id': 'req-1529b54d-e145-4b28-a698-ffbe48a93e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:14.494997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0fe03f7f8d4c909649dbc48a29d257', 'request_id': 'req-1529b54d-e145-4b28-a698-ffbe48a93e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:14.500582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0fe03f7f8d4c909649dbc48a29d257', 'request_id': 'req-1529b54d-e145-4b28-a698-ffbe48a93e88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:14.512050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] The token cache is being invalidate because project 0e0fe03f7f8d4c909649dbc48a29d257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:14.512336 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:14.512961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1529b54d-e145-4b28-a698-ffbe48a93e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:14.514542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1101/2216] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:14 2022] DELETE /identity/v3/projects/0e0fe03f7f8d4c909649dbc48a29d257 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:14.519820 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c772b-afa1-403c-8dea-faa43134cb52 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.520115 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c772b-afa1-403c-8dea-faa43134cb52 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.520383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c772b-afa1-403c-8dea-faa43134cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.539743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d62c772b-afa1-403c-8dea-faa43134cb52 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:14.541050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d62c772b-afa1-403c-8dea-faa43134cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:14.587732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:14.601283 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1116/2217] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:14.612273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a0da-9f17-4b5c-bd70-d941441c19a4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.612554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a0da-9f17-4b5c-bd70-d941441c19a4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.612827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a0da-9f17-4b5c-bd70-d941441c19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.632823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ad61a0da-9f17-4b5c-bd70-d941441c19a4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:14.634004 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ad61a0da-9f17-4b5c-bd70-d941441c19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:14.641752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1102/2218] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:14.646040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c772b-afa1-403c-8dea-faa43134cb52 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.655532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c772b-afa1-403c-8dea-faa43134cb52 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.660155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.660668 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.660945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.661212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.661850 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:14.662148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.663713 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.675337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1117/2219] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:14.679494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a0da-9f17-4b5c-bd70-d941441c19a4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.689456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a0da-9f17-4b5c-bd70-d941441c19a4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.694029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.694624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.694902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.695174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.695833 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.697731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.724408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1103/2220] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:14 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:14.728624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.738848 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855149c-e5fb-4501-b088-b263a2bc062a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.793512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.794190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.794513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.794825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.795504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.797444 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.819084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1118/2221] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:14 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:14.823182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.833557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a76b0-d0b9-45b6-adc6-5eba90f3aafc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.838194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.838789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.839070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.839343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.840019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.841611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.852013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1104/2222] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:14.855970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.866688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144290c-b648-458b-b3aa-fa5ea45b8b2a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.871198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb40da-8a87-4817-9bf9-42824324db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.871780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb40da-8a87-4817-9bf9-42824324db05 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.872097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb40da-8a87-4817-9bf9-42824324db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.872391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb40da-8a87-4817-9bf9-42824324db05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.873021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb40da-8a87-4817-9bf9-42824324db05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.874627 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb40da-8a87-4817-9bf9-42824324db05 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.885198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1119/2223] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:14.889213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:14.898928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8326-5192-4246-a437-fbe54da5cf17 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:14.903507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:14.904153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.904431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.904703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] PATH_INFO: `/v3/projects/ed1c6c574b6444d39b4f2869fdca4006/users/a18dfd8e73ef46e6b76343df2d8b6818/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.919276 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1c6c574b6444d39b4f2869fdca4006, user_id=a18dfd8e73ef46e6b76343df2d8b6818, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:14.921843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:14.935813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1105/2224] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:14 2022] PUT /identity/v3/projects/ed1c6c574b6444d39b4f2869fdca4006/users/a18dfd8e73ef46e6b76343df2d8b6818/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:14.946404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021a538-1c8b-40a6-b049-0bbd2b5abbf2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:14.946693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021a538-1c8b-40a6-b049-0bbd2b5abbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:14.946969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021a538-1c8b-40a6-b049-0bbd2b5abbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:14.974238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5021a538-1c8b-40a6-b049-0bbd2b5abbf2 None None] MFA Rules not processed for user `a18dfd8e73ef46e6b76343df2d8b6818`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:14.975429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5021a538-1c8b-40a6-b049-0bbd2b5abbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:15.038057 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1120/2225] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:15.042711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:15.106583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56bb1-49a7-441a-9552-5ad24f15db11 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:15.111280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:15.111928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.112219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.112464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.113082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:15.114949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:15.141311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1106/2226] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:15 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:15.146049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021a538-1c8b-40a6-b049-0bbd2b5abbf2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:15.156923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021a538-1c8b-40a6-b049-0bbd2b5abbf2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:15.204451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:15.218050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:15.218776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.219063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.219335 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.220025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:15.222352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:15.250308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1121/2227] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:15 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:15.253021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:15.264650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594cc8f-3142-49cb-abb5-a35da46bb5fc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:15.271685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:15.272394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.272659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.272927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.273574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:15.275203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:15.289278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1107/2228] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:15.295329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:15.307442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03595c9c-0ca1-4785-84bb-9fefa61ef465 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:15.316177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:15.317030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.317964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.319003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] PATH_INFO: `/v3/projects/0a05de1961c1441e8efff96c60dc4f50/users/35ddfb0c2d0e4777993f199b91f746a8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.336942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a05de1961c1441e8efff96c60dc4f50, user_id=35ddfb0c2d0e4777993f199b91f746a8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:15.340849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:15.355951 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1122/2229] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:15 2022] PUT /identity/v3/projects/0a05de1961c1441e8efff96c60dc4f50/users/35ddfb0c2d0e4777993f199b91f746a8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:15.359825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:15.372121 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff42a5-eee1-4d5e-9224-42d5209db122 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:15.386587 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:15.452932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053730f-0f62-4fc7-9183-3c97e112f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:15.453778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053730f-0f62-4fc7-9183-3c97e112f7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.454251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053730f-0f62-4fc7-9183-3c97e112f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.454688 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053730f-0f62-4fc7-9183-3c97e112f7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.455495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053730f-0f62-4fc7-9183-3c97e112f7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:15.457672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053730f-0f62-4fc7-9183-3c97e112f7f9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:15.475119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1108/2230] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:15.476236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:15.490877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e848c2-694c-4ce5-b58f-38419ae3bf99 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:15.496320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:15.499704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.499704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.499704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] PATH_INFO: `/v3/projects/0a05de1961c1441e8efff96c60dc4f50/users/35ddfb0c2d0e4777993f199b91f746a8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.507290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a05de1961c1441e8efff96c60dc4f50, user_id=35ddfb0c2d0e4777993f199b91f746a8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:15.510192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:15.522515 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1123/2231] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:15 2022] PUT /identity/v3/projects/0a05de1961c1441e8efff96c60dc4f50/users/35ddfb0c2d0e4777993f199b91f746a8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:15.533248 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450ccd5-c0b7-4f25-a3a9-145bb01fedd0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.533569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450ccd5-c0b7-4f25-a3a9-145bb01fedd0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.533851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450ccd5-c0b7-4f25-a3a9-145bb01fedd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.565308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a450ccd5-c0b7-4f25-a3a9-145bb01fedd0 None None] MFA Rules not processed for user `35ddfb0c2d0e4777993f199b91f746a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:15.567548 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a450ccd5-c0b7-4f25-a3a9-145bb01fedd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:15.638320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1109/2232] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:15.649206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:15.650877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:15.707870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7767f-8947-4526-8fc3-6659bcd0f970 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:15.711356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:15.711994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.712276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.712547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.769979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:15.771421 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:15.780344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1124/2233] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:18.337658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450ccd5-c0b7-4f25-a3a9-145bb01fedd0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:18.347262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450ccd5-c0b7-4f25-a3a9-145bb01fedd0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:18.350866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45e8d3-9a1b-48d0-bfcd-68f0bb914832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:18.351476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e8d3-9a1b-48d0-bfcd-68f0bb914832 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:18.351768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e8d3-9a1b-48d0-bfcd-68f0bb914832 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:18.352067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e8d3-9a1b-48d0-bfcd-68f0bb914832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:18.361433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45e8d3-9a1b-48d0-bfcd-68f0bb914832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:18.362863 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45e8d3-9a1b-48d0-bfcd-68f0bb914832 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:18.372331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1110/2234] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:20.959574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:20.961019 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:20.993941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:20.994436 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:20.994521 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.015934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] MFA Rules not processed for user `2b118893cb8e4542be3c02dd61648c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:21.017320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:21.042268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:21.048217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369ae1-c3de-452b-9c9e-7bfc7ee1fb18 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:21.054702 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:21.055654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.056221 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.056611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] PATH_INFO: `/v3/users/55132062ad194d6bb0ade30c3538d4c5` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.058599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55132062ad194d6bb0ade30c3538d4c5)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:21.060917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:21.082202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1111/2235] 10.222.0.45 () {58 vars in 967 bytes} [Wed Oct 12 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:21.097618 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:21.099112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:21.116174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55132062ad194d6bb0ade30c3538d4c5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.116845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55132062ad194d6bb0ade30c3538d4c5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.134174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:21.134549 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55132062ad194d6bb0ade30c3538d4c5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.136341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55132062ad194d6bb0ade30c3538d4c5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.147024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-038cc655-7997-4d65-9d3c-6eb1a18902a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55132062ad194d6bb0ade30c3538d4c5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.162125 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1125/2236] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:20 2022] DELETE /identity/v3/users/55132062ad194d6bb0ade30c3538d4c5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:21.168817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.169084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.169357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.192568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:21.193038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc50c45-2707-4249-8d9a-66a4bfd2739e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:21.194212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:21.262970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1126/2237] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:21.270915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc6e24255b28424ebb02c9319b40b25d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:21.271826 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.272130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.272396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.272566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:21.273875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:21.274128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:21.345071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:21.348048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:21.350429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7678c9-28d3-4202-be74-9ac85a3a1b69 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:21.354624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:21.355420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.355982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.356412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.356636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1112/2238] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Oct 12 12:35:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 12:35:21.371239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:21.373036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:21.402860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1127/2239] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:21.662283 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:21.663742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:21.677764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedbe4b-0800-4ef2-827f-c21601729e27 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:21.682721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:21.683407 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.683689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.683996 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] PATH_INFO: `/v3/projects/b422ec83a1e14931b4d759190e3cfd6d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.685392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b422ec83a1e14931b4d759190e3cfd6d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:21.687412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:21.739748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b422ec83a1e14931b4d759190e3cfd6d', 'request_id': 'req-57663c05-999c-43d7-b7f6-b1cb43e7526d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.747611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b422ec83a1e14931b4d759190e3cfd6d', 'request_id': 'req-57663c05-999c-43d7-b7f6-b1cb43e7526d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.754199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b422ec83a1e14931b4d759190e3cfd6d', 'request_id': 'req-57663c05-999c-43d7-b7f6-b1cb43e7526d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.756915 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:21.771162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] The token cache is being invalidate because project b422ec83a1e14931b4d759190e3cfd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:21.771607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.772369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.774106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1113/2240] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:21 2022] DELETE /identity/v3/projects/b422ec83a1e14931b4d759190e3cfd6d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:21.778399 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:21.788676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18e7d-0325-4e00-b30f-427cf656f5c9 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:21.801003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:21.846855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:21.847476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.847756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.848064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] PATH_INFO: `/v3/users/30a0560778ca488bbc5fffec339ad1c8` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.849171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a0560778ca488bbc5fffec339ad1c8)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:21.851075 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:21.896630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a0560778ca488bbc5fffec339ad1c8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.897281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a0560778ca488bbc5fffec339ad1c8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.910697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a0560778ca488bbc5fffec339ad1c8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.911308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a0560778ca488bbc5fffec339ad1c8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.918094 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff60ccd-38e8-414c-b3f2-ea25e42d2019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a0560778ca488bbc5fffec339ad1c8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:21.931953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1128/2241] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:21 2022] DELETE /identity/v3/users/30a0560778ca488bbc5fffec339ad1c8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:22.196235 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.197672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:22.210455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57663c05-999c-43d7-b7f6-b1cb43e7526d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.268966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.269630 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.269909 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.270178 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] PATH_INFO: `/v3/projects/013fea3e4c004f1ba2b55a1c79657fd9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.271316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013fea3e4c004f1ba2b55a1c79657fd9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.273245 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.321869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013fea3e4c004f1ba2b55a1c79657fd9', 'request_id': 'req-391e1b75-bca5-4389-b8e8-bd70e434d883'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:22.329520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013fea3e4c004f1ba2b55a1c79657fd9', 'request_id': 'req-391e1b75-bca5-4389-b8e8-bd70e434d883'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:22.335249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013fea3e4c004f1ba2b55a1c79657fd9', 'request_id': 'req-391e1b75-bca5-4389-b8e8-bd70e434d883'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:22.347817 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] The token cache is being invalidate because project 013fea3e4c004f1ba2b55a1c79657fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:22.348193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:22.348923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-391e1b75-bca5-4389-b8e8-bd70e434d883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:22.350411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1114/2242] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:22 2022] DELETE /identity/v3/projects/013fea3e4c004f1ba2b55a1c79657fd9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:22.355349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34e058-d7a2-4249-ae91-fa78e0cb433c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.355832 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34e058-d7a2-4249-ae91-fa78e0cb433c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.355945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34e058-d7a2-4249-ae91-fa78e0cb433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.377079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-af34e058-d7a2-4249-ae91-fa78e0cb433c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:22.378343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-af34e058-d7a2-4249-ae91-fa78e0cb433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:22.442372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1129/2243] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:22.451431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdc47d-b469-4d14-97c2-558fe413881b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.451715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdc47d-b469-4d14-97c2-558fe413881b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.452062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdc47d-b469-4d14-97c2-558fe413881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.472609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fdcdc47d-b469-4d14-97c2-558fe413881b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:22.473827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fdcdc47d-b469-4d14-97c2-558fe413881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:22.482036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1115/2244] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:22.486268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34e058-d7a2-4249-ae91-fa78e0cb433c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.496635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34e058-d7a2-4249-ae91-fa78e0cb433c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.501471 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.502106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.502389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.502693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.503343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:22.503648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.505313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.517420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1130/2245] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:22.521829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdc47d-b469-4d14-97c2-558fe413881b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.531403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdc47d-b469-4d14-97c2-558fe413881b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.537010 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.537620 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.537901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.538175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.538825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.540786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.572122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1116/2246] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:22 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:22.576561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.586799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8774f1-b2d9-4160-a94d-7a467356f9c5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.610020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:22.651186 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.651789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.652100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.652375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.653015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.654971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.676018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1131/2247] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:22 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:22.680120 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.690797 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10fbb3-3f58-47f6-92d7-e43c0782c20a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.695609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.696183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.696466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.696740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.697385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.698974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.709256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1117/2248] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:22.713161 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.723231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39cf78-51b5-4b87-a5f3-a6a424c7b33b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.727882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12447-485c-452d-a78e-caa6e6a9aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.728463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12447-485c-452d-a78e-caa6e6a9aac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.728743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12447-485c-452d-a78e-caa6e6a9aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.729034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12447-485c-452d-a78e-caa6e6a9aac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.729671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12447-485c-452d-a78e-caa6e6a9aac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.731275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12447-485c-452d-a78e-caa6e6a9aac7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.740858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1132/2249] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:22.744755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.754447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dfd39-77ea-427f-a577-57d0a4a880cb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.759116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.759767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.760081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.760359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] PATH_INFO: `/v3/projects/fad72444e1c34ebcb43054c0a9374c99/users/2fe16daf73da49f3b412f3b7e41c025e/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.776019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad72444e1c34ebcb43054c0a9374c99, user_id=2fe16daf73da49f3b412f3b7e41c025e, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.778661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.792425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1118/2250] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:22 2022] PUT /identity/v3/projects/fad72444e1c34ebcb43054c0a9374c99/users/2fe16daf73da49f3b412f3b7e41c025e/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:22.802629 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cab7b-0bf3-4b60-b169-2f699a6c1f08 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.802953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cab7b-0bf3-4b60-b169-2f699a6c1f08 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.803229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cab7b-0bf3-4b60-b169-2f699a6c1f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.832141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d20cab7b-0bf3-4b60-b169-2f699a6c1f08 None None] MFA Rules not processed for user `2fe16daf73da49f3b412f3b7e41c025e`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:22.833344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d20cab7b-0bf3-4b60-b169-2f699a6c1f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:22.895117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1133/2251] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:22.899504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:22.924447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:22.962949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfbeb-a7f3-4c03-bfac-a8842feb0a7a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.967424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.968050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.968504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.968778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.969409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.971941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.997945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1119/2252] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:22 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:23.002015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cab7b-0bf3-4b60-b169-2f699a6c1f08 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:23.012802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cab7b-0bf3-4b60-b169-2f699a6c1f08 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:23.068898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:23.069493 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.069777 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.070055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.070691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:23.072635 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:23.093900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1134/2253] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:23 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:23.097769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:23.107710 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ebcf7-a369-41f6-9ad2-ef5c5806e362 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:23.112369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:23.112963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.113239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.113507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.114142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:23.115711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:23.125913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1120/2254] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:23.130200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:23.139912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e4bd-8d92-4833-89ae-f4385efad886 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:23.145091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:23.145718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.145994 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.146263 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] PATH_INFO: `/v3/projects/f3acb31bb72a484d9dc8416f22ff0d0a/users/7d81b3878e8849eba8fc6bb03398ecb8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.160350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3acb31bb72a484d9dc8416f22ff0d0a, user_id=7d81b3878e8849eba8fc6bb03398ecb8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:23.162960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:23.170716 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:23.177550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1135/2255] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:23 2022] PUT /identity/v3/projects/f3acb31bb72a484d9dc8416f22ff0d0a/users/7d81b3878e8849eba8fc6bb03398ecb8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:23.181354 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:23.191892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4a4db-2c45-49bb-8aac-0d161951073f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:23.246965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaa2de-16b9-4c4a-929b-2a8e18fa073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:23.247590 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaa2de-16b9-4c4a-929b-2a8e18fa073b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.247755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaa2de-16b9-4c4a-929b-2a8e18fa073b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.248062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaa2de-16b9-4c4a-929b-2a8e18fa073b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.248703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaa2de-16b9-4c4a-929b-2a8e18fa073b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:23.250280 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaa2de-16b9-4c4a-929b-2a8e18fa073b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:23.259828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1121/2256] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:23.264093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:23.274178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf17da-29c9-4e61-880a-0559c4ec93ab admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:23.278810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:23.279450 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.279731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.280127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] PATH_INFO: `/v3/projects/f3acb31bb72a484d9dc8416f22ff0d0a/users/7d81b3878e8849eba8fc6bb03398ecb8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.282018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3acb31bb72a484d9dc8416f22ff0d0a, user_id=7d81b3878e8849eba8fc6bb03398ecb8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:23.285193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:23.295082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1136/2257] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:23 2022] PUT /identity/v3/projects/f3acb31bb72a484d9dc8416f22ff0d0a/users/7d81b3878e8849eba8fc6bb03398ecb8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:23.306583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf71fb-4694-4dad-9be3-35e0d69e57c7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.306904 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf71fb-4694-4dad-9be3-35e0d69e57c7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.307186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf71fb-4694-4dad-9be3-35e0d69e57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.334774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ebaf71fb-4694-4dad-9be3-35e0d69e57c7 None None] MFA Rules not processed for user `7d81b3878e8849eba8fc6bb03398ecb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:23.336013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ebaf71fb-4694-4dad-9be3-35e0d69e57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:23.406939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1122/2258] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:23.419012 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:23.420814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:23.483134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749251-f7a1-4cb3-aad3-ece460c4565c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:23.486841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3dace-c118-4121-96bb-0dfd0fb97ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:23.487502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3dace-c118-4121-96bb-0dfd0fb97ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.487778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3dace-c118-4121-96bb-0dfd0fb97ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.488084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3dace-c118-4121-96bb-0dfd0fb97ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.498065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3dace-c118-4121-96bb-0dfd0fb97ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:23.499604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3dace-c118-4121-96bb-0dfd0fb97ce8 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:23.509252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1137/2259] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:23.909798 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf71fb-4694-4dad-9be3-35e0d69e57c7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:23.927940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:23.978127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf71fb-4694-4dad-9be3-35e0d69e57c7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:23.982575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:23.983194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:23.983473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:23.983744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] PATH_INFO: `/v3/users/2fe16daf73da49f3b412f3b7e41c025e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:23.984870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe16daf73da49f3b412f3b7e41c025e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:23.986762 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:24.031119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe16daf73da49f3b412f3b7e41c025e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.031715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe16daf73da49f3b412f3b7e41c025e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.038569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe16daf73da49f3b412f3b7e41c025e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.039193 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe16daf73da49f3b412f3b7e41c025e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.050783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe16daf73da49f3b412f3b7e41c025e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.062913 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1123/2260] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:23 2022] DELETE /identity/v3/users/2fe16daf73da49f3b412f3b7e41c025e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:24.067811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:24.068113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:24.068390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:24.087425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:24.088647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:24.145526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1138/2261] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:24.155092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:24.156500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:24.214627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a4be-bd80-403f-8eca-1f4929e1b0e4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:24.218297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:24.218902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:24.219185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:24.219460 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:24.228408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:24.229886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:24.239738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1124/2262] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:24.503909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:24.505973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:24.521134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa8eb-0f49-4ab4-bba3-28f86d7cfe8c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:24.526774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:24.527407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:24.527691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:24.528070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] PATH_INFO: `/v3/projects/fad72444e1c34ebcb43054c0a9374c99` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:24.529107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad72444e1c34ebcb43054c0a9374c99)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:24.531044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:24.577434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad72444e1c34ebcb43054c0a9374c99', 'request_id': 'req-33eb085f-d8c4-4d44-8238-9edff527c863'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.583645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad72444e1c34ebcb43054c0a9374c99', 'request_id': 'req-33eb085f-d8c4-4d44-8238-9edff527c863'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.590590 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad72444e1c34ebcb43054c0a9374c99', 'request_id': 'req-33eb085f-d8c4-4d44-8238-9edff527c863'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.601708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] The token cache is being invalidate because project fad72444e1c34ebcb43054c0a9374c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:24.602030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.602656 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.604163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1139/2263] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:24 2022] DELETE /identity/v3/projects/fad72444e1c34ebcb43054c0a9374c99 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:24.608643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:24.620179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87abfb-96a4-455e-a8b7-a500168cf900 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:24.656351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:24.676577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:24.677198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:24.677479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:24.677751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] PATH_INFO: `/v3/users/7d81b3878e8849eba8fc6bb03398ecb8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:24.678859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d81b3878e8849eba8fc6bb03398ecb8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:24.680807 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:24.730325 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d81b3878e8849eba8fc6bb03398ecb8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.730973 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d81b3878e8849eba8fc6bb03398ecb8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.740595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d81b3878e8849eba8fc6bb03398ecb8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.741230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d81b3878e8849eba8fc6bb03398ecb8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.754804 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c87b2c54-5e45-4390-b205-938b92a07035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d81b3878e8849eba8fc6bb03398ecb8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:24.776112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1125/2264] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:24 2022] DELETE /identity/v3/users/7d81b3878e8849eba8fc6bb03398ecb8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:25.053786 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.055333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:25.073108 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb085f-d8c4-4d44-8238-9edff527c863 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.085981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:25.136492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.137040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.137321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.137591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] PATH_INFO: `/v3/projects/f3acb31bb72a484d9dc8416f22ff0d0a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.138802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3acb31bb72a484d9dc8416f22ff0d0a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.140738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.185398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3acb31bb72a484d9dc8416f22ff0d0a', 'request_id': 'req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:25.191484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3acb31bb72a484d9dc8416f22ff0d0a', 'request_id': 'req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:25.198242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3acb31bb72a484d9dc8416f22ff0d0a', 'request_id': 'req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:25.210758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] The token cache is being invalidate because project f3acb31bb72a484d9dc8416f22ff0d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:25.211054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:25.211705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c6e59f1-0fe2-4b1b-bc56-6946c8068643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:25.213271 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1140/2265] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:25 2022] DELETE /identity/v3/projects/f3acb31bb72a484d9dc8416f22ff0d0a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:25.218265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1c0b-72fb-4293-a163-1ccb59d208ce None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.218554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1c0b-72fb-4293-a163-1ccb59d208ce None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.218830 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1c0b-72fb-4293-a163-1ccb59d208ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.238795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4ace1c0b-72fb-4293-a163-1ccb59d208ce None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:25.240028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4ace1c0b-72fb-4293-a163-1ccb59d208ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:25.297428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1126/2266] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:25.305390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b293d0-b91d-4c94-b6df-d1dfdaaf855b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.305685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b293d0-b91d-4c94-b6df-d1dfdaaf855b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.305968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b293d0-b91d-4c94-b6df-d1dfdaaf855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.326419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-76b293d0-b91d-4c94-b6df-d1dfdaaf855b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:25.327948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-76b293d0-b91d-4c94-b6df-d1dfdaaf855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:25.336742 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1141/2267] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:25.340788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace1c0b-72fb-4293-a163-1ccb59d208ce None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.350485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace1c0b-72fb-4293-a163-1ccb59d208ce None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.355197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.355790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.356099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.356373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.357013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:25.357312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.358922 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.370300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1127/2268] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:25.374216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b293d0-b91d-4c94-b6df-d1dfdaaf855b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.383941 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b293d0-b91d-4c94-b6df-d1dfdaaf855b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.388714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.389248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.389532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.389806 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.390458 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.392717 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.420795 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1142/2269] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:25 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:25.424901 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.434697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff248a-7514-46dc-b62d-52c5ecdfc5df admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.477581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:25.491072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.491664 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.491984 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.492256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.492883 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.494778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.517592 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1128/2270] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:25 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:25.522222 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.532258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5329d1-a41a-4b95-90b3-e63641484da2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.537026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.537630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.537916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.538192 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.538868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.540510 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.550320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1143/2271] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:25.553990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.563921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c327-f2eb-48b3-b182-cbcf4a4f1711 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.568986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec4d8-9340-4b9e-a0f1-a0fa553070be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.569557 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec4d8-9340-4b9e-a0f1-a0fa553070be admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.569832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec4d8-9340-4b9e-a0f1-a0fa553070be admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.570099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec4d8-9340-4b9e-a0f1-a0fa553070be admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.570732 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec4d8-9340-4b9e-a0f1-a0fa553070be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.572329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec4d8-9340-4b9e-a0f1-a0fa553070be admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.583160 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1129/2272] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:25.587178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.597142 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf372b-da51-4dd0-8cf1-97dbe623fae3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.601778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.602415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.602699 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.602973 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] PATH_INFO: `/v3/projects/5c4ee0c3250644d8acb8846b9805c42d/users/ef423ebe5d19483a8fb62f451c89b2f5/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.617449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4ee0c3250644d8acb8846b9805c42d, user_id=ef423ebe5d19483a8fb62f451c89b2f5, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.620121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.632419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1144/2273] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:25 2022] PUT /identity/v3/projects/5c4ee0c3250644d8acb8846b9805c42d/users/ef423ebe5d19483a8fb62f451c89b2f5/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:25.642624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eed0-5ab0-489b-8626-9fa46ff49b1c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.643087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eed0-5ab0-489b-8626-9fa46ff49b1c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.643187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eed0-5ab0-489b-8626-9fa46ff49b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.670344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8e90eed0-5ab0-489b-8626-9fa46ff49b1c None None] MFA Rules not processed for user `ef423ebe5d19483a8fb62f451c89b2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:25.671523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8e90eed0-5ab0-489b-8626-9fa46ff49b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:25.732972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1130/2274] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:25.738003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.779587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:25.801793 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5d7d-d094-4b49-81a7-de6367231f7a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.806475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.807074 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.807357 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.807633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.808311 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.810484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.836767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1145/2275] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:25 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:25.840861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90eed0-5ab0-489b-8626-9fa46ff49b1c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.851284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90eed0-5ab0-489b-8626-9fa46ff49b1c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.909902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.910512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.910792 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.911061 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.911684 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.913601 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.936312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1131/2276] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:25 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:25.941364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:25.953199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558357c9-bf40-4bbb-a33f-8ad4968baee4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.961841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.968148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.969076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.969322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.969984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.971621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.984740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1146/2277] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:25.990063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:26.000109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464f2a-20f7-4b66-815f-5463b085fb73 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:26.005458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:26.006125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:26.006401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:26.006674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] PATH_INFO: `/v3/projects/ce320feddaef4a04bb47d1ef83e1ed90/users/deb809fa0b12459e82b0abede0e83f9b/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:26.023251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce320feddaef4a04bb47d1ef83e1ed90, user_id=deb809fa0b12459e82b0abede0e83f9b, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:26.026430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:26.041667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1132/2278] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:25 2022] PUT /identity/v3/projects/ce320feddaef4a04bb47d1ef83e1ed90/users/deb809fa0b12459e82b0abede0e83f9b/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:26.045815 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:26.056463 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03be1f-be07-4627-a1bf-a537b6090584 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:26.118649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd6473-1452-4a1e-be05-9de9ca5f88f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:26.119256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6473-1452-4a1e-be05-9de9ca5f88f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:26.119544 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6473-1452-4a1e-be05-9de9ca5f88f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:26.120642 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6473-1452-4a1e-be05-9de9ca5f88f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:26.121347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd6473-1452-4a1e-be05-9de9ca5f88f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:26.123282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd6473-1452-4a1e-be05-9de9ca5f88f2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:26.141996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1147/2279] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:26.143541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:26.155463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6fd25-b74f-4994-bfeb-295254ac2e96 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:26.160766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:26.161417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:26.161758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:26.162032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] PATH_INFO: `/v3/projects/ce320feddaef4a04bb47d1ef83e1ed90/users/deb809fa0b12459e82b0abede0e83f9b/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:26.164042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce320feddaef4a04bb47d1ef83e1ed90, user_id=deb809fa0b12459e82b0abede0e83f9b, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:26.166925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:26.178565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1133/2280] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:26 2022] PUT /identity/v3/projects/ce320feddaef4a04bb47d1ef83e1ed90/users/deb809fa0b12459e82b0abede0e83f9b/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:26.189814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a242-2b8c-43d5-8092-4e0432c1591d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:26.190138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a242-2b8c-43d5-8092-4e0432c1591d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:26.190414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a242-2b8c-43d5-8092-4e0432c1591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:26.217442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-50b6a242-2b8c-43d5-8092-4e0432c1591d None None] MFA Rules not processed for user `deb809fa0b12459e82b0abede0e83f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:26.218631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-50b6a242-2b8c-43d5-8092-4e0432c1591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:26.287406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1148/2281] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:26.301502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:26.303233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:26.313902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:26.363729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00036-889e-4272-9f5d-9a191da4447e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:26.367329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:26.367954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:26.368233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:26.368502 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:26.377164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:26.378582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:26.387736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1134/2282] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:26.461368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a242-2b8c-43d5-8092-4e0432c1591d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:26.470698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a242-2b8c-43d5-8092-4e0432c1591d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:26.474816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49675a-8fe6-4bda-a562-b4ee39c2ebcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:26.475402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49675a-8fe6-4bda-a562-b4ee39c2ebcc service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:26.475679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49675a-8fe6-4bda-a562-b4ee39c2ebcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:26.475979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49675a-8fe6-4bda-a562-b4ee39c2ebcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:26.504743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:26.532670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49675a-8fe6-4bda-a562-b4ee39c2ebcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:26.534711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49675a-8fe6-4bda-a562-b4ee39c2ebcc service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:26.543405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1149/2283] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:31.118415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:31.119877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:31.182647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba8a85-06c6-4fb3-af06-4f1dcfcf020b service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:31.188297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:31.188944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:31.189249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:31.189613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] PATH_INFO: `/v3/users/a18dfd8e73ef46e6b76343df2d8b6818` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:31.190861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18dfd8e73ef46e6b76343df2d8b6818)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:31.192801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:31.239146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18dfd8e73ef46e6b76343df2d8b6818'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.239819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18dfd8e73ef46e6b76343df2d8b6818'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.246197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18dfd8e73ef46e6b76343df2d8b6818'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.246859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18dfd8e73ef46e6b76343df2d8b6818'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.259444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18dfd8e73ef46e6b76343df2d8b6818'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.272672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1135/2284] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:31 2022] DELETE /identity/v3/users/a18dfd8e73ef46e6b76343df2d8b6818 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:31.277718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:31.278207 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:31.278320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:31.296696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:31.297888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:31.356322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1150/2285] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:31.365943 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:31.367365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:31.400311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:31.426603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419eb58-1b79-46aa-b084-b6a6c298a7b0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:31.430515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:31.431126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:31.431437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:31.431712 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:31.441458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:31.442877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:31.452732 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1136/2286] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:31.716784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:31.718202 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:31.732522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec28f0-6ebd-4359-a4b4-b8df1a43660d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:31.737696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:31.738408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:31.738787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:31.739087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] PATH_INFO: `/v3/projects/ed1c6c574b6444d39b4f2869fdca4006` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:31.740249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1c6c574b6444d39b4f2869fdca4006)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:31.742146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:31.789296 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1c6c574b6444d39b4f2869fdca4006', 'request_id': 'req-d277ece3-129e-4ec2-8650-6d7a7092fbc1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.795593 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1c6c574b6444d39b4f2869fdca4006', 'request_id': 'req-d277ece3-129e-4ec2-8650-6d7a7092fbc1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.803688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1c6c574b6444d39b4f2869fdca4006', 'request_id': 'req-d277ece3-129e-4ec2-8650-6d7a7092fbc1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.814526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] The token cache is being invalidate because project ed1c6c574b6444d39b4f2869fdca4006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:31.814823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.816016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.817510 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1151/2287] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:31 2022] DELETE /identity/v3/projects/ed1c6c574b6444d39b4f2869fdca4006 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:31.821465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:31.831072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11136190-f3c3-43bc-adf0-ff12fb46ff72 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:31.885497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:31.886109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:31.886386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:31.886657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] PATH_INFO: `/v3/users/35ddfb0c2d0e4777993f199b91f746a8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:31.887756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ddfb0c2d0e4777993f199b91f746a8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:31.889675 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:31.933925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ddfb0c2d0e4777993f199b91f746a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.934531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ddfb0c2d0e4777993f199b91f746a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.942720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ddfb0c2d0e4777993f199b91f746a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.943397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ddfb0c2d0e4777993f199b91f746a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.955319 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a16dc538-7ded-4093-8315-fcc9620e56b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ddfb0c2d0e4777993f199b91f746a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:31.967376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1137/2288] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:31 2022] DELETE /identity/v3/users/35ddfb0c2d0e4777993f199b91f746a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:32.251141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:32.252971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:32.270255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277ece3-129e-4ec2-8650-6d7a7092fbc1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:32.333128 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:32.341415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:32.342426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.342718 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.344407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] PATH_INFO: `/v3/projects/0a05de1961c1441e8efff96c60dc4f50` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.345821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a05de1961c1441e8efff96c60dc4f50)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:32.348997 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:32.403762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a05de1961c1441e8efff96c60dc4f50', 'request_id': 'req-52e00f9d-1b48-4ef0-a364-be19dffc30d6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:32.411497 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a05de1961c1441e8efff96c60dc4f50', 'request_id': 'req-52e00f9d-1b48-4ef0-a364-be19dffc30d6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:32.420123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a05de1961c1441e8efff96c60dc4f50', 'request_id': 'req-52e00f9d-1b48-4ef0-a364-be19dffc30d6'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:32.432090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] The token cache is being invalidate because project 0a05de1961c1441e8efff96c60dc4f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:32.432395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:32.433058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-52e00f9d-1b48-4ef0-a364-be19dffc30d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:32.434577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1152/2289] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:32 2022] DELETE /identity/v3/projects/0a05de1961c1441e8efff96c60dc4f50 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:32.440617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784fcd-e2f1-455d-8544-041e537ac4ef None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.441111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784fcd-e2f1-455d-8544-041e537ac4ef None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.441111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784fcd-e2f1-455d-8544-041e537ac4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.462047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8f784fcd-e2f1-455d-8544-041e537ac4ef None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:32.463337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8f784fcd-e2f1-455d-8544-041e537ac4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:32.508842 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:32.526001 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1138/2290] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:32.534707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4bd4-470a-464f-8be9-bc2230048199 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.534992 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4bd4-470a-464f-8be9-bc2230048199 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.535265 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4bd4-470a-464f-8be9-bc2230048199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.556790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c7cd4bd4-470a-464f-8be9-bc2230048199 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:32.558065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c7cd4bd4-470a-464f-8be9-bc2230048199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:32.567030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1153/2291] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:32.571778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784fcd-e2f1-455d-8544-041e537ac4ef None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:32.582119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784fcd-e2f1-455d-8544-041e537ac4ef None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:32.586907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:32.587574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.587886 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.588163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.588811 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:32.589112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:32.590742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:32.603369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1139/2292] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:32.607843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd4bd4-470a-464f-8be9-bc2230048199 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:32.619164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd4bd4-470a-464f-8be9-bc2230048199 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:32.623836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:32.624442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.624726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.624999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.625633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:32.627524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:32.654692 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1154/2293] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:32 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:32.660031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:32.669708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb939-6faa-4c14-90d7-1b316a908a7c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:32.725454 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:32.725980 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.726260 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.726534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.727155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:32.729103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:32.749949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1140/2294] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:32 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:32.754772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:32.765211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dd611-08c5-4829-a510-f91426309cbe admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:32.770389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:32.770987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.771264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.771538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.772210 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:32.773829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:32.783666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1155/2295] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:32.787602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:32.797499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423dffb-60df-4a3c-b373-faa43599a630 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:32.802145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e49c9-9849-468b-82a7-917e752544cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:32.802731 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e49c9-9849-468b-82a7-917e752544cb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.803013 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e49c9-9849-468b-82a7-917e752544cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.803284 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e49c9-9849-468b-82a7-917e752544cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.804103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e49c9-9849-468b-82a7-917e752544cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:32.805866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e49c9-9849-468b-82a7-917e752544cb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:32.818126 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1141/2296] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:32.822408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:32.832744 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818f32a-a55b-477f-b2d6-9664887730f7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:32.837250 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:32.837880 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.838154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.838422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] PATH_INFO: `/v3/projects/5d4d4c21a94348d58fd90c1016610c37/users/136764d712fa4412a9965fbd5a50d61e/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.852387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4d4c21a94348d58fd90c1016610c37, user_id=136764d712fa4412a9965fbd5a50d61e, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:32.854988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:32.868472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1156/2297] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:32 2022] PUT /identity/v3/projects/5d4d4c21a94348d58fd90c1016610c37/users/136764d712fa4412a9965fbd5a50d61e/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:32.879317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f307c40-0dbf-4663-9ae8-85a660bddbe2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:32.879604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f307c40-0dbf-4663-9ae8-85a660bddbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:32.879911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f307c40-0dbf-4663-9ae8-85a660bddbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:32.907634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9f307c40-0dbf-4663-9ae8-85a660bddbe2 None None] MFA Rules not processed for user `136764d712fa4412a9965fbd5a50d61e`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:32.908891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f307c40-0dbf-4663-9ae8-85a660bddbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:32.972023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1142/2298] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:32.976682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.037020 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd210f-093c-4260-9a23-37a846a88769 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.041583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.042174 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.042454 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.042724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.043359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.045280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.071520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1157/2299] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:32 2022] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:33.075637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f307c40-0dbf-4663-9ae8-85a660bddbe2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.086734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f307c40-0dbf-4663-9ae8-85a660bddbe2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.129309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:33.142211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.142810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.143119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.143992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.144613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.146514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.166852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1143/2300] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:33 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:33.170894 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.181472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75184e1-e2dc-426e-95ee-343bd09c3e77 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.186356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.186946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.187228 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.187502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.188170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.189759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.191559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:33.202604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1158/2301] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:33.206708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.221782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ac76b-163b-422c-8ee6-f5e8eb242f0b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.226418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.227125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.227349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.227621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] PATH_INFO: `/v3/projects/30ade8c93e3741b5935c28b96ac5e452/users/0674e8946a334410b8e0b85ff0d71015/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.242483 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ade8c93e3741b5935c28b96ac5e452, user_id=0674e8946a334410b8e0b85ff0d71015, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.245176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.258770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1144/2302] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:33 2022] PUT /identity/v3/projects/30ade8c93e3741b5935c28b96ac5e452/users/0674e8946a334410b8e0b85ff0d71015/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:33.262737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.272588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca5d95-c002-4297-bb8c-5f869f2249f6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.327845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e2d7-c64d-4164-9530-cca6af9065f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.328441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e2d7-c64d-4164-9530-cca6af9065f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.328721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e2d7-c64d-4164-9530-cca6af9065f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.328990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e2d7-c64d-4164-9530-cca6af9065f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.329626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e2d7-c64d-4164-9530-cca6af9065f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.331239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e2d7-c64d-4164-9530-cca6af9065f9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.340567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1159/2303] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:33.344705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.354968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc183-c32b-4a60-af40-9cac3bcede55 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.359728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.360397 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.360680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.360960 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] PATH_INFO: `/v3/projects/30ade8c93e3741b5935c28b96ac5e452/users/0674e8946a334410b8e0b85ff0d71015/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.363448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ade8c93e3741b5935c28b96ac5e452, user_id=0674e8946a334410b8e0b85ff0d71015, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.366130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.376673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1145/2304] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:33 2022] PUT /identity/v3/projects/30ade8c93e3741b5935c28b96ac5e452/users/0674e8946a334410b8e0b85ff0d71015/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:33.388551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.388840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.389117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.421195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] MFA Rules not processed for user `0674e8946a334410b8e0b85ff0d71015`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:33.422206 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:33.495525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1160/2305] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:33.508508 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.510372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:33.547601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.549037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:33.577787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e06e1-350a-4fe8-a466-be9e4a4c4418 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.581486 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.582083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.582359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.582622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.591638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.593104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.603690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1146/2306] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:33.616278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b9c92-408f-4e11-aac1-e9d6f7faf58f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.620959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.621607 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.621876 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.622154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] PATH_INFO: `/v3/users/ef423ebe5d19483a8fb62f451c89b2f5` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.623396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef423ebe5d19483a8fb62f451c89b2f5)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.626216 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.653967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:33.681724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef423ebe5d19483a8fb62f451c89b2f5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:33.682388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef423ebe5d19483a8fb62f451c89b2f5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:33.686811 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.695079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef423ebe5d19483a8fb62f451c89b2f5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:33.695430 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e5a94-7cd2-4bfb-935f-0b7acc4aae43 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.695787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef423ebe5d19483a8fb62f451c89b2f5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:33.699190 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.699859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.700088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.700412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.703124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:33.704200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-723d8c4f-be2a-430c-ae3b-aada4b18e838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef423ebe5d19483a8fb62f451c89b2f5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:33.717096 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1161/2307] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:33 2022] DELETE /identity/v3/users/ef423ebe5d19483a8fb62f451c89b2f5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:33.721268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.722085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.722732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.742533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:33.743804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:33.763568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.765214 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.782150 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1147/2308] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:33.814842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1162/2309] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:33.824589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:33.826033 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:33.870720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:33.886764 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450d19-4953-4050-aff0-f0247bb1c88e service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:33.938281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:33.939037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:33.939323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:33.939600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:33.950179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:33.951663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:33.962697 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1148/2310] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:34.230938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:34.232419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:34.247366 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7061183-2f1e-4882-9743-c2154171fbf1 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:34.252580 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:34.253846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:34.254173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:34.254434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] PATH_INFO: `/v3/projects/5c4ee0c3250644d8acb8846b9805c42d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:34.255638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4ee0c3250644d8acb8846b9805c42d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:34.257502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:34.304852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4ee0c3250644d8acb8846b9805c42d', 'request_id': 'req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.311356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4ee0c3250644d8acb8846b9805c42d', 'request_id': 'req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.318420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4ee0c3250644d8acb8846b9805c42d', 'request_id': 'req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.328645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] The token cache is being invalidate because project 5c4ee0c3250644d8acb8846b9805c42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:34.328932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.329550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.331018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1163/2311] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:34 2022] DELETE /identity/v3/projects/5c4ee0c3250644d8acb8846b9805c42d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:34.334931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:34.344545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ba03c-ebd6-41b0-8a4a-0ea2fcbe1fe1 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:34.399753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:34.400398 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:34.400681 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:34.400956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] PATH_INFO: `/v3/users/deb809fa0b12459e82b0abede0e83f9b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:34.402054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb809fa0b12459e82b0abede0e83f9b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:34.404002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:34.451071 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb809fa0b12459e82b0abede0e83f9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.451715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb809fa0b12459e82b0abede0e83f9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.458824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb809fa0b12459e82b0abede0e83f9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.459442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb809fa0b12459e82b0abede0e83f9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.471255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d4232952-8045-4dfb-90bf-027549076211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb809fa0b12459e82b0abede0e83f9b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.483772 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1149/2312] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:34 2022] DELETE /identity/v3/users/deb809fa0b12459e82b0abede0e83f9b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:34.754924 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:34.756485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:34.770650 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f758e7-cd5d-4ad8-a4d9-e2b77c3e0b77 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:34.794008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:34.835609 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:34.836281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:34.836560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:34.836840 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] PATH_INFO: `/v3/projects/ce320feddaef4a04bb47d1ef83e1ed90` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:34.837967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce320feddaef4a04bb47d1ef83e1ed90)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:34.840213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:34.886040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce320feddaef4a04bb47d1ef83e1ed90', 'request_id': 'req-96616e2f-c3ef-4dac-a22b-47a3b786b832'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.892160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce320feddaef4a04bb47d1ef83e1ed90', 'request_id': 'req-96616e2f-c3ef-4dac-a22b-47a3b786b832'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.900301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce320feddaef4a04bb47d1ef83e1ed90', 'request_id': 'req-96616e2f-c3ef-4dac-a22b-47a3b786b832'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.911280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] The token cache is being invalidate because project ce320feddaef4a04bb47d1ef83e1ed90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:34.911592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.912280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96616e2f-c3ef-4dac-a22b-47a3b786b832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:34.913745 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1164/2313] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:34 2022] DELETE /identity/v3/projects/ce320feddaef4a04bb47d1ef83e1ed90 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:34.918523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c5ca-a204-4490-b437-185fdbf75d9e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:34.919002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c5ca-a204-4490-b437-185fdbf75d9e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:34.919116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c5ca-a204-4490-b437-185fdbf75d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:34.939735 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4962c5ca-a204-4490-b437-185fdbf75d9e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:34.940981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4962c5ca-a204-4490-b437-185fdbf75d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:34.952690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:35.000990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1150/2314] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:35.009543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d3ad-8e61-4990-960d-a8d3f050bedd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.009768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d3ad-8e61-4990-960d-a8d3f050bedd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.010044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d3ad-8e61-4990-960d-a8d3f050bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.035523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b219d3ad-8e61-4990-960d-a8d3f050bedd None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:35.036750 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b219d3ad-8e61-4990-960d-a8d3f050bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:35.044521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1165/2315] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:35.049101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c5ca-a204-4490-b437-185fdbf75d9e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.058936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c5ca-a204-4490-b437-185fdbf75d9e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.063753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.064392 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.064677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.064955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.066357 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:35.066662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.068565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.080156 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1151/2316] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:35.085052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219d3ad-8e61-4990-960d-a8d3f050bedd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.094551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219d3ad-8e61-4990-960d-a8d3f050bedd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.099269 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.099895 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.100176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.100448 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.101085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.102975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.130657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1166/2317] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:35 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:35.134778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.145431 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcce445-6e61-4ab1-9544-77a726276b1f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.201852 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.202503 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.202855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.203194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.203912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.206447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.228500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1152/2318] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:35 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:35.232518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.243022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aca3d-7f87-4598-9068-e76a0e039a9d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.247759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.248384 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.248664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.248936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.249573 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.251193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.261676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1167/2319] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:35.265499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.276307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3182855-41f6-41d4-bca2-abbded0e20e9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.281463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015b8f9-54c7-43e5-8d75-664b84ca2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.282066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b8f9-54c7-43e5-8d75-664b84ca2218 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.282349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b8f9-54c7-43e5-8d75-664b84ca2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.282628 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b8f9-54c7-43e5-8d75-664b84ca2218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.283277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015b8f9-54c7-43e5-8d75-664b84ca2218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.284978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015b8f9-54c7-43e5-8d75-664b84ca2218 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.300277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1153/2320] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:35.302091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.312530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d035ee-7030-4593-a214-e52caaf23786 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.317734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.318383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.318662 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.318938 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] PATH_INFO: `/v3/projects/effc448438a545e380bca0db87bf3a87/users/6cbb34ed090845e49e22874474e5a719/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.334863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=effc448438a545e380bca0db87bf3a87, user_id=6cbb34ed090845e49e22874474e5a719, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.337546 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.351968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1168/2321] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:35 2022] PUT /identity/v3/projects/effc448438a545e380bca0db87bf3a87/users/6cbb34ed090845e49e22874474e5a719/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:35.362305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f275-d42a-4802-b23f-ce8364b580de None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.362668 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f275-d42a-4802-b23f-ce8364b580de None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.363012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f275-d42a-4802-b23f-ce8364b580de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.394255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-54d0f275-d42a-4802-b23f-ce8364b580de None None] MFA Rules not processed for user `6cbb34ed090845e49e22874474e5a719`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:35.395487 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-54d0f275-d42a-4802-b23f-ce8364b580de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:35.462467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1154/2322] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:35.466950 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.518425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:35.531149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409ae1-e234-40e1-b6bc-3a965c04d4fa admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.536327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.536931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.537243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.537516 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.538934 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.541882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.570029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1169/2323] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:35 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:35.574006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0f275-d42a-4802-b23f-ce8364b580de None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.584649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0f275-d42a-4802-b23f-ce8364b580de None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.593552 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:35.643594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.644225 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.644506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.644778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.645401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.647305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.667514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1155/2324] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:35 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:35.671654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.682389 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c1d33-3c17-4cb0-b1ec-2e8626669153 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.687292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.687964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.688252 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.688530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.689171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.691403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.702061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1170/2325] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:35.706109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.715899 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8741-96c4-4cf0-afae-3dd53f715c5d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.720463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.721100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.721378 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.721648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] PATH_INFO: `/v3/projects/d8924151c2d1453b897d3eed185d834c/users/8c90373a067d480ab577fb9214be1f6d/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.735991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8924151c2d1453b897d3eed185d834c, user_id=8c90373a067d480ab577fb9214be1f6d, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.739130 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.751455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1156/2326] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:35 2022] PUT /identity/v3/projects/d8924151c2d1453b897d3eed185d834c/users/8c90373a067d480ab577fb9214be1f6d/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:35.758542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.768666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee9eb8-5362-4c07-8d9e-03b2305a85b8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.825324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89d304-f5b7-4f96-a626-257a02bfcaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.825931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89d304-f5b7-4f96-a626-257a02bfcaeb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.826211 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89d304-f5b7-4f96-a626-257a02bfcaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.826484 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89d304-f5b7-4f96-a626-257a02bfcaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.827122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89d304-f5b7-4f96-a626-257a02bfcaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.828757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89d304-f5b7-4f96-a626-257a02bfcaeb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.838291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1171/2327] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:35.842605 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:35.853414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984770fe-bd2b-4405-90a9-a0438bc7f416 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:35.858049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:35.858721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.859000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.859270 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] PATH_INFO: `/v3/projects/d8924151c2d1453b897d3eed185d834c/users/8c90373a067d480ab577fb9214be1f6d/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.861237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8924151c2d1453b897d3eed185d834c, user_id=8c90373a067d480ab577fb9214be1f6d, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:35.864493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:35.874555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1157/2328] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:35 2022] PUT /identity/v3/projects/d8924151c2d1453b897d3eed185d834c/users/8c90373a067d480ab577fb9214be1f6d/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:35.939333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:35.939621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:35.939943 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:35.967178 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] MFA Rules not processed for user `8c90373a067d480ab577fb9214be1f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:35.968403 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:36.037398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1172/2329] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:36.048917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:36.051376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:36.107689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedec34c-d43d-44a3-a29b-e8d28a23bbf3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:36.111382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:36.112588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:36.112869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:36.113141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:36.122099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:36.123514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:36.132994 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1158/2330] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:36.176935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:36.178322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:36.190582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35855655-01b9-4373-bf5c-a84d5f660fec None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:36.194227 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ba1f-bfa2-4a4e-905c-e632eb01d4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:36.195126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ba1f-bfa2-4a4e-905c-e632eb01d4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:36.195409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ba1f-bfa2-4a4e-905c-e632eb01d4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:36.195681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ba1f-bfa2-4a4e-905c-e632eb01d4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:36.236272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:36.253141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ba1f-bfa2-4a4e-905c-e632eb01d4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:36.254566 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ba1f-bfa2-4a4e-905c-e632eb01d4f0 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:36.263257 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1173/2331] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:37.893535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:37.895124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:37.977381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b72c45-49b5-4ff7-b7fd-2641ad13a4f9 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:37.982089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:37.982721 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:37.983015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:37.983273 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] PATH_INFO: `/v3/users/136764d712fa4412a9965fbd5a50d61e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:37.985047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] RBAC: Authorizing `identity:delete_user(user_id=136764d712fa4412a9965fbd5a50d61e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:37.986453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:37.999028 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:38.055117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136764d712fa4412a9965fbd5a50d61e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.055964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136764d712fa4412a9965fbd5a50d61e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.064483 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136764d712fa4412a9965fbd5a50d61e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.065309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136764d712fa4412a9965fbd5a50d61e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.077205 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136764d712fa4412a9965fbd5a50d61e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.090075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1159/2332] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:37 2022] DELETE /identity/v3/users/136764d712fa4412a9965fbd5a50d61e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:38.094576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:38.095064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:38.095181 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:38.115026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:38.116276 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:38.175720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1174/2333] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:38.185793 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:38.187229 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:38.244396 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5215-bc2f-4f44-b627-7133ee3372be admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:38.248019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:38.248615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:38.248895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:38.249167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:38.258000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:38.259412 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:38.268612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1160/2334] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:38.537038 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:38.538486 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:38.550543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e376f6e-9a19-4851-b73f-cbb61c23e595 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:38.555456 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:38.556248 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:38.556617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:38.556896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] PATH_INFO: `/v3/projects/5d4d4c21a94348d58fd90c1016610c37` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:38.558058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4d4c21a94348d58fd90c1016610c37)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:38.560289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:38.606586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4d4c21a94348d58fd90c1016610c37', 'request_id': 'req-5c5e90ee-233b-430e-9da4-02c7d1abf53b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.613343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4d4c21a94348d58fd90c1016610c37', 'request_id': 'req-5c5e90ee-233b-430e-9da4-02c7d1abf53b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.621258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4d4c21a94348d58fd90c1016610c37', 'request_id': 'req-5c5e90ee-233b-430e-9da4-02c7d1abf53b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.633032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] The token cache is being invalidate because project 5d4d4c21a94348d58fd90c1016610c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:38.633350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.633976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.635498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1175/2335] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:38 2022] DELETE /identity/v3/projects/5d4d4c21a94348d58fd90c1016610c37 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:38.639514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:38.649569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d613540-7906-451f-90f5-dd60215fb61b service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:38.703765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:38.704400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:38.704683 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:38.704953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] PATH_INFO: `/v3/users/0674e8946a334410b8e0b85ff0d71015` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:38.706056 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0674e8946a334410b8e0b85ff0d71015)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:38.708571 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:38.741093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:38.754549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0674e8946a334410b8e0b85ff0d71015'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.755196 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0674e8946a334410b8e0b85ff0d71015'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.762812 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0674e8946a334410b8e0b85ff0d71015'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.763642 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0674e8946a334410b8e0b85ff0d71015'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.776366 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c7807e2-5363-452d-a309-81c57ba3a6c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0674e8946a334410b8e0b85ff0d71015'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:38.788581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1161/2336] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:38 2022] DELETE /identity/v3/users/0674e8946a334410b8e0b85ff0d71015 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:39.056651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.059232 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.078200 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e90ee-233b-430e-9da4-02c7d1abf53b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.144377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.145120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.145478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.145755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] PATH_INFO: `/v3/projects/30ade8c93e3741b5935c28b96ac5e452` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.146902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ade8c93e3741b5935c28b96ac5e452)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.148857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.164407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:39.199846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ade8c93e3741b5935c28b96ac5e452', 'request_id': 'req-6c1c05b2-850a-4afe-bc27-f56229d28ab1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.206049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ade8c93e3741b5935c28b96ac5e452', 'request_id': 'req-6c1c05b2-850a-4afe-bc27-f56229d28ab1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.213327 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ade8c93e3741b5935c28b96ac5e452', 'request_id': 'req-6c1c05b2-850a-4afe-bc27-f56229d28ab1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.224631 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] The token cache is being invalidate because project 30ade8c93e3741b5935c28b96ac5e452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:39.224923 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.225536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6c1c05b2-850a-4afe-bc27-f56229d28ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.227031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1176/2337] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:39 2022] DELETE /identity/v3/projects/30ade8c93e3741b5935c28b96ac5e452 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:39.232024 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934908-a9c2-44a9-8a42-25e34ef1f6b3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.232478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934908-a9c2-44a9-8a42-25e34ef1f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.232786 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934908-a9c2-44a9-8a42-25e34ef1f6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.253299 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-08934908-a9c2-44a9-8a42-25e34ef1f6b3 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:39.255262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-08934908-a9c2-44a9-8a42-25e34ef1f6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.318902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1162/2338] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:39.327145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4305-59e0-4c0d-8883-f07f38f50b57 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.327439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4305-59e0-4c0d-8883-f07f38f50b57 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.327719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4305-59e0-4c0d-8883-f07f38f50b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.347987 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-140a4305-59e0-4c0d-8883-f07f38f50b57 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:39.349196 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-140a4305-59e0-4c0d-8883-f07f38f50b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.357175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1177/2339] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:39.361626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934908-a9c2-44a9-8a42-25e34ef1f6b3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.371091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08934908-a9c2-44a9-8a42-25e34ef1f6b3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.375706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.376328 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.376607 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.376882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.377524 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:39.377828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.380045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.393621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1163/2340] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:39.397034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a4305-59e0-4c0d-8883-f07f38f50b57 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.406245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a4305-59e0-4c0d-8883-f07f38f50b57 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.411245 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.412077 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.412356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.412626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.413270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.415159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.448318 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1178/2341] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:39.449495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.460087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd3d8-4e03-4682-baa3-88a72f87e989 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.518685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.519962 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.520249 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.520523 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.521142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.523031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.547750 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1164/2342] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:39.548926 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.559487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9cf11-4b4c-4a9d-8e74-311b4ea15b05 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.564651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.565240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.565571 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.565847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.567113 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.568720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.578589 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1179/2343] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:39.582610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.592954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9703351-9390-44be-a0b3-ddfffef4aaba admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.597920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.598603 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.598981 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.599252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.599925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.601495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.605189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.607333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.612825 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1165/2344] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:39.617560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.624329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d70cf-c83f-4141-acbb-a7c21ee2428c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.627073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5585-82d9-40cd-b416-eef6a12fe647 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.629509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.630124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.630408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.630671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] PATH_INFO: `/v3/users/6cbb34ed090845e49e22874474e5a719` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.631773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbb34ed090845e49e22874474e5a719)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.632739 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257f80-16de-42f5-afab-dfa90aaf9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.633374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257f80-16de-42f5-afab-dfa90aaf9614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.633698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.633805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257f80-16de-42f5-afab-dfa90aaf9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.633969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257f80-16de-42f5-afab-dfa90aaf9614 admin admin] PATH_INFO: `/v3/projects/53147bdda0d94be0b169d7dcb3a00f60/users/f68262aabbd74b26aaa273cc2477cdba/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.646441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:39.649956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257f80-16de-42f5-afab-dfa90aaf9614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53147bdda0d94be0b169d7dcb3a00f60, user_id=f68262aabbd74b26aaa273cc2477cdba, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.653359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257f80-16de-42f5-afab-dfa90aaf9614 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.667729 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1166/2345] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:39 2022] PUT /identity/v3/projects/53147bdda0d94be0b169d7dcb3a00f60/users/f68262aabbd74b26aaa273cc2477cdba/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:39.678398 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.678757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.679106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.685428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbb34ed090845e49e22874474e5a719'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.686102 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbb34ed090845e49e22874474e5a719'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.698538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbb34ed090845e49e22874474e5a719'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.699198 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbb34ed090845e49e22874474e5a719'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.708377 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a068d66f-c3f4-4e05-8812-9fe922955e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbb34ed090845e49e22874474e5a719'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:39.709058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] MFA Rules not processed for user `f68262aabbd74b26aaa273cc2477cdba`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:39.710374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.721887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1180/2346] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:39 2022] DELETE /identity/v3/users/6cbb34ed090845e49e22874474e5a719 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:39.726500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.726972 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.727251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.747502 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:39.748740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.770611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:39.792553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1167/2347] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:39.796877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.798143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.813292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1181/2348] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:39.824007 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.825409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:39.864805 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8ac96-2548-494f-8867-49dafdcb0f81 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.870567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.871594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.871907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.872186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.872824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.875474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.890751 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a42842-820d-4f7d-b6c9-36cc8d199b5a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.894534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.895146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.895425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.895700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.905100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.905251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1168/2349] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:39.906638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.909144 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:39.917462 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1182/2350] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:39.973187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f011ca2-e3f0-4f51-a145-e5bbc58b5089 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:39.978070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:39.978678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:39.978955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:39.979227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:39.979897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:39.981824 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:39.993311 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:40.005423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1169/2351] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:39 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:40.009293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.019879 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c25080-4939-45b7-bbb6-6821fa9747e9 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.024704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.025300 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.025583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.025858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.026500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.028158 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.038659 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1183/2352] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:40.042743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.053231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708af316-2aea-478e-a45f-4b10e9831a4d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.057988 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.058639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.058923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.059819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] PATH_INFO: `/v3/projects/63e8a2ef4503470e9641f59305c603db/users/40d7d40c78214e969b8e730a456a09d8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.078495 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e8a2ef4503470e9641f59305c603db, user_id=40d7d40c78214e969b8e730a456a09d8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.081391 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.095053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1170/2353] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:40 2022] PUT /identity/v3/projects/63e8a2ef4503470e9641f59305c603db/users/40d7d40c78214e969b8e730a456a09d8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:40.099511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.109741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493034-91b4-47f2-aee0-a0767511d299 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.169811 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.170435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.170612 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.170887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.171527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.173184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.183540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1184/2354] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:40.188073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.198492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.200341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:40.202042 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913b538-b8cd-45e0-8fbf-90eceb891bc2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.213667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b62a2-5245-4f00-9b1c-78aee8ec7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.214280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c70162-53a1-406c-8f7e-1325a1f5b35f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.214409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b62a2-5245-4f00-9b1c-78aee8ec7a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.214638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b62a2-5245-4f00-9b1c-78aee8ec7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.214976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b62a2-5245-4f00-9b1c-78aee8ec7a9e admin admin] PATH_INFO: `/v3/projects/63e8a2ef4503470e9641f59305c603db/users/40d7d40c78214e969b8e730a456a09d8/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.216969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b62a2-5245-4f00-9b1c-78aee8ec7a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e8a2ef4503470e9641f59305c603db, user_id=40d7d40c78214e969b8e730a456a09d8, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.219771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b62a2-5245-4f00-9b1c-78aee8ec7a9e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.220130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.220758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.221567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.221567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] PATH_INFO: `/v3/projects/effc448438a545e380bca0db87bf3a87` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.225921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=effc448438a545e380bca0db87bf3a87)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.228569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.231917 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1171/2355] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:40 2022] PUT /identity/v3/projects/63e8a2ef4503470e9641f59305c603db/users/40d7d40c78214e969b8e730a456a09d8/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:40.244184 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.244774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.244774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.273949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] MFA Rules not processed for user `40d7d40c78214e969b8e730a456a09d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:40.275175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:40.277034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effc448438a545e380bca0db87bf3a87', 'request_id': 'req-5558c939-2c3f-4226-bbbd-d4bd73b49524'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.278133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:40.286293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effc448438a545e380bca0db87bf3a87', 'request_id': 'req-5558c939-2c3f-4226-bbbd-d4bd73b49524'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.297952 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effc448438a545e380bca0db87bf3a87', 'request_id': 'req-5558c939-2c3f-4226-bbbd-d4bd73b49524'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.309550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] The token cache is being invalidate because project effc448438a545e380bca0db87bf3a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:40.309868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.310798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.312568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1185/2356] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:40 2022] DELETE /identity/v3/projects/effc448438a545e380bca0db87bf3a87 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:40.316953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.318419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:40.360256 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1172/2357] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:40.369032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.370470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:40.385122 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558c939-2c3f-4226-bbbd-d4bd73b49524 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.390114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.390740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.391025 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.391297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] PATH_INFO: `/v3/users/8c90373a067d480ab577fb9214be1f6d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.392569 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c90373a067d480ab577fb9214be1f6d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.395166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.428319 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9fcd-3c1a-47e9-96cd-84b14ac90d56 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.432268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e1b28-8704-4124-b5b2-5a82c9973a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.432874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e1b28-8704-4124-b5b2-5a82c9973a7e service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.433153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e1b28-8704-4124-b5b2-5a82c9973a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.433427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e1b28-8704-4124-b5b2-5a82c9973a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.435442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-301e1b28-8704-4124-b5b2-5a82c9973a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:40.443021 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c90373a067d480ab577fb9214be1f6d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.443694 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c90373a067d480ab577fb9214be1f6d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.456061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c90373a067d480ab577fb9214be1f6d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.457261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c90373a067d480ab577fb9214be1f6d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.465976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c90373a067d480ab577fb9214be1f6d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.479652 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1186/2358] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:40 2022] DELETE /identity/v3/users/8c90373a067d480ab577fb9214be1f6d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:40.495759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e1b28-8704-4124-b5b2-5a82c9973a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.497241 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e1b28-8704-4124-b5b2-5a82c9973a7e service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.500777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:40.507987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1173/2359] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:40.775595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:40.777127 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:40.860341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:40.865229 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1afaf1-8b9e-415b-a225-9c0c8898c2bd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:40.870846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:40.871615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.872240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.872844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] PATH_INFO: `/v3/projects/d8924151c2d1453b897d3eed185d834c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.875003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8924151c2d1453b897d3eed185d834c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:40.877440 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:40.926386 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8924151c2d1453b897d3eed185d834c', 'request_id': 'req-ae5997ed-06ce-483c-84f4-97a06b73e8d3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.932601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8924151c2d1453b897d3eed185d834c', 'request_id': 'req-ae5997ed-06ce-483c-84f4-97a06b73e8d3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.940530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8924151c2d1453b897d3eed185d834c', 'request_id': 'req-ae5997ed-06ce-483c-84f4-97a06b73e8d3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.951233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] The token cache is being invalidate because project d8924151c2d1453b897d3eed185d834c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:40.951460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.952105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ae5997ed-06ce-483c-84f4-97a06b73e8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:40.953584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1187/2360] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:40 2022] DELETE /identity/v3/projects/d8924151c2d1453b897d3eed185d834c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:40.958468 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208fbbe-8ab6-48d3-98da-0ebeeb52943a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:40.958766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208fbbe-8ab6-48d3-98da-0ebeeb52943a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:40.959049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208fbbe-8ab6-48d3-98da-0ebeeb52943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:40.978989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4208fbbe-8ab6-48d3-98da-0ebeeb52943a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:40.980222 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4208fbbe-8ab6-48d3-98da-0ebeeb52943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:41.038847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1174/2361] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:41.046556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea255f-e765-4014-838a-25881b574f0e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.046845 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea255f-e765-4014-838a-25881b574f0e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.047118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea255f-e765-4014-838a-25881b574f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.066964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8dea255f-e765-4014-838a-25881b574f0e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:41.068199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8dea255f-e765-4014-838a-25881b574f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:41.076053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1188/2362] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:41.080278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208fbbe-8ab6-48d3-98da-0ebeeb52943a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.090383 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208fbbe-8ab6-48d3-98da-0ebeeb52943a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.095037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.095636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.095964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.096244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.096889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:41.097194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.099328 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.110766 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1175/2363] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:41.114977 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea255f-e765-4014-838a-25881b574f0e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.124146 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea255f-e765-4014-838a-25881b574f0e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.128724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.129308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.129587 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.129888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.130513 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.132430 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.160990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1189/2364] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:41 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:41.165089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.174780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db6bd-b4a6-4e7c-9aa8-9d18d02cafe3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.231717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.232298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.232581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.232892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.233555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.235613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.255459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1176/2365] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:41 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:41.259517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.270143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de445de-e9bf-40b8-bee6-29f57875ded7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.274736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.275328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.275610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.275919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.276592 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.278180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.288559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1190/2366] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:41.292309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.302211 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585819-f26e-4fe0-871f-cf659ad7ab42 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.306890 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a101319-68f7-4a70-a7ff-0b825cdb3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.307477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101319-68f7-4a70-a7ff-0b825cdb3909 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.307760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101319-68f7-4a70-a7ff-0b825cdb3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.308073 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101319-68f7-4a70-a7ff-0b825cdb3909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.308715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a101319-68f7-4a70-a7ff-0b825cdb3909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.310559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a101319-68f7-4a70-a7ff-0b825cdb3909 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.320905 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1177/2367] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:41.325072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.335379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35ba6-8343-4101-a21a-e3549704a60e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.340159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.340828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.341106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.341402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] PATH_INFO: `/v3/projects/1795d70a77f7479e883d81946660db43/users/70ccddd6ed3249efb41b0557b1e0d1cd/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.356270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1795d70a77f7479e883d81946660db43, user_id=70ccddd6ed3249efb41b0557b1e0d1cd, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.358875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.371249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1191/2368] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:41 2022] PUT /identity/v3/projects/1795d70a77f7479e883d81946660db43/users/70ccddd6ed3249efb41b0557b1e0d1cd/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:41.383153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c06d-bfc9-482b-bdda-0936e2fd1b89 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.383539 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c06d-bfc9-482b-bdda-0936e2fd1b89 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.383857 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c06d-bfc9-482b-bdda-0936e2fd1b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.411645 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e143c06d-bfc9-482b-bdda-0936e2fd1b89 None None] MFA Rules not processed for user `70ccddd6ed3249efb41b0557b1e0d1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:41.412893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e143c06d-bfc9-482b-bdda-0936e2fd1b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:41.466919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:41.478030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1178/2369] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:41.482673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.542226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd277fe-cd98-4832-b97a-3e534d427611 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.546772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.547359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.547638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.548017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.548643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.550526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.576828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1192/2370] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:41 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:41.581054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c06d-bfc9-482b-bdda-0936e2fd1b89 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.592067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c06d-bfc9-482b-bdda-0936e2fd1b89 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.651426 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.652066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.652367 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.652640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.653269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.655174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.675466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1179/2371] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:41 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:41.679523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.691599 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6704f0-0035-4517-a139-17be4708a167 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.696292 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.696944 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.697243 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.697512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.698147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.699774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.701888 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:41.714555 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1193/2372] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:41.718689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.728563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1a628-19e0-4b0a-878a-a447cb5a3abe admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.733139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.733717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.733993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.734265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] PATH_INFO: `/v3/projects/909e12ff326d4f8487ca9b75f70a8376/users/320ce8e66fae4bb6b6953a11888e8dde/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.748940 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909e12ff326d4f8487ca9b75f70a8376, user_id=320ce8e66fae4bb6b6953a11888e8dde, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.751570 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.766535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1180/2373] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:41 2022] PUT /identity/v3/projects/909e12ff326d4f8487ca9b75f70a8376/users/320ce8e66fae4bb6b6953a11888e8dde/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:41.771050 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.780849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627544-4438-4dfc-beff-bac82e165ba9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.836720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb7a50-ba5c-4474-9c7d-a610c3c9ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.837470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7a50-ba5c-4474-9c7d-a610c3c9ce53 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.837759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7a50-ba5c-4474-9c7d-a610c3c9ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.838037 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7a50-ba5c-4474-9c7d-a610c3c9ce53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.838841 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb7a50-ba5c-4474-9c7d-a610c3c9ce53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.840364 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb7a50-ba5c-4474-9c7d-a610c3c9ce53 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.850772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1194/2374] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:41.854942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:41.865887 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354d55-30e1-4059-81ec-244513ffc571 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:41.870845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:41.871541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.871866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.872143 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] PATH_INFO: `/v3/projects/909e12ff326d4f8487ca9b75f70a8376/users/320ce8e66fae4bb6b6953a11888e8dde/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.874036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=909e12ff326d4f8487ca9b75f70a8376, user_id=320ce8e66fae4bb6b6953a11888e8dde, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:41.876700 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:41.887689 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1181/2375] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:41 2022] PUT /identity/v3/projects/909e12ff326d4f8487ca9b75f70a8376/users/320ce8e66fae4bb6b6953a11888e8dde/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:41.897821 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268348-ab8c-4c36-8f6b-fdef810825c2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:41.898114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268348-ab8c-4c36-8f6b-fdef810825c2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:41.898392 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268348-ab8c-4c36-8f6b-fdef810825c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:41.926585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-81268348-ab8c-4c36-8f6b-fdef810825c2 None None] MFA Rules not processed for user `320ce8e66fae4bb6b6953a11888e8dde`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:41.927842 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-81268348-ab8c-4c36-8f6b-fdef810825c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:41.997611 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1195/2376] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:42.010650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:42.012705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:42.079331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbe26-3f1c-41f9-94e2-98f1cd6eb44b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:42.083008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:42.083612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:42.083936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:42.084213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:42.093746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:42.095393 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:42.104801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1182/2377] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:42.418520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268348-ab8c-4c36-8f6b-fdef810825c2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:42.428112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268348-ab8c-4c36-8f6b-fdef810825c2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:42.432641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320ce8e66fae4bb6b6953a11888e8dde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909e12ff326d4f8487ca9b75f70a8376', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:42.433231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:42.433509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:42.433781 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:42.434451 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:42.434761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:42.436643 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:42.447707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1196/2378] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:42.451685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:42.460889 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241a30-6490-441f-8c4e-2768fbc9ad3f service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:42.465730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320ce8e66fae4bb6b6953a11888e8dde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909e12ff326d4f8487ca9b75f70a8376', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:42.466316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:42.466608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:42.466885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:42.467540 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:42.469477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:42.496218 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1183/2379] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:42 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:42.500333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:42.510233 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b96de-e2b8-48f6-a41a-fcb287cbeb21 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:42.566308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320ce8e66fae4bb6b6953a11888e8dde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909e12ff326d4f8487ca9b75f70a8376', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:42.566912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:42.567199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:42.567485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:42.568238 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:42.568551 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:42.570147 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:42.578417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:42.585823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1197/2380] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:42.622034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:42.632181 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806e50-b912-4819-aa59-30dc7d8f7319 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:42.636589 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320ce8e66fae4bb6b6953a11888e8dde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '909e12ff326d4f8487ca9b75f70a8376', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:42.637230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:42.637513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:42.637782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] PATH_INFO: `/v3/projects/83057c8eb5d141abb1caf6fb4bfca043` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:42.638888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorizing `identity:delete_project(project_id=83057c8eb5d141abb1caf6fb4bfca043)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:42.640814 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:42.664323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:42.688411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83057c8eb5d141abb1caf6fb4bfca043', 'request_id': 'req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:42.695465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83057c8eb5d141abb1caf6fb4bfca043', 'request_id': 'req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:42.701019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83057c8eb5d141abb1caf6fb4bfca043', 'request_id': 'req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:42.712806 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] The token cache is being invalidate because project 83057c8eb5d141abb1caf6fb4bfca043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:42.713097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:42.713748 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:42.715387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1184/2381] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:42 2022] DELETE /identity/v3/projects/83057c8eb5d141abb1caf6fb4bfca043 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:42.906700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:42.908439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:42.973176 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c5bbd-0c68-46f1-a42a-5d1907b2ef02 tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:43.027061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:43.027691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.028001 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.028278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] PATH_INFO: `/v3/users/70ccddd6ed3249efb41b0557b1e0d1cd` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.029409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ccddd6ed3249efb41b0557b1e0d1cd)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:43.031320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:43.076822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ccddd6ed3249efb41b0557b1e0d1cd'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.077483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ccddd6ed3249efb41b0557b1e0d1cd'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.085795 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:43.087491 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.093197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ccddd6ed3249efb41b0557b1e0d1cd'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.093887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ccddd6ed3249efb41b0557b1e0d1cd'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.101785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafc38b-5113-4da2-8a95-318d7ffd7bbb tempest-VolumeQuotaClassesTest-28102779 tempest-VolumeQuotaClassesTest-28102779-project-admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:43.102394 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b695ea41-0876-4424-80bb-1dd8f13a06a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ccddd6ed3249efb41b0557b1e0d1cd'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.107226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:43.107728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.108034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.108303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] PATH_INFO: `/v3/users/f68262aabbd74b26aaa273cc2477cdba` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.109428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68262aabbd74b26aaa273cc2477cdba)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:43.111381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:43.115740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1198/2382] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:42 2022] DELETE /identity/v3/users/70ccddd6ed3249efb41b0557b1e0d1cd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:43.120068 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.120358 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.120640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.140602 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:43.141830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.162950 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68262aabbd74b26aaa273cc2477cdba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.163124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:43.163701 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68262aabbd74b26aaa273cc2477cdba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.171837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68262aabbd74b26aaa273cc2477cdba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.172515 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68262aabbd74b26aaa273cc2477cdba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.184604 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4c90785f-2d3f-4255-865e-ece32fa0c079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68262aabbd74b26aaa273cc2477cdba'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.197763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1185/2383] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:43 2022] DELETE /identity/v3/users/f68262aabbd74b26aaa273cc2477cdba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:43.202020 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a16b-5283-428b-8826-d4f11ad690ed None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.202326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a16b-5283-428b-8826-d4f11ad690ed None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.202583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a16b-5283-428b-8826-d4f11ad690ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.206045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1199/2384] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:43.216580 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:43.218051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.223451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f354a16b-5283-428b-8826-d4f11ad690ed None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:43.224650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f354a16b-5283-428b-8826-d4f11ad690ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.275153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d85ea5-25e8-4c12-aba6-f39e8e90e213 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:43.285540 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1186/2385] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:43.295275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354a16b-5283-428b-8826-d4f11ad690ed None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:43.321598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:43.327912 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:43.328603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.328800 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.329104 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.338393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:43.339761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:43.349610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1200/2386] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:43.355209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354a16b-5283-428b-8826-d4f11ad690ed None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:43.358836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:43.359467 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.359934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.360210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.369948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:43.371406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:43.382067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1187/2387] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:43.714649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:43.716964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.731768 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7987-2ec3-4bf9-9500-829d44bf3bc7 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:43.736724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:43.737354 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.737639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.738505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] PATH_INFO: `/v3/projects/1795d70a77f7479e883d81946660db43` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.739660 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1795d70a77f7479e883d81946660db43)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:43.741662 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:43.779927 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:43.782034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.796344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb681214-25ec-4006-bd0a-925849b8d12c service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:43.806817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1795d70a77f7479e883d81946660db43', 'request_id': 'req-22a69065-d273-4049-a426-8ccc445244d1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.814404 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1795d70a77f7479e883d81946660db43', 'request_id': 'req-22a69065-d273-4049-a426-8ccc445244d1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.823492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1795d70a77f7479e883d81946660db43', 'request_id': 'req-22a69065-d273-4049-a426-8ccc445244d1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.834664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] The token cache is being invalidate because project 1795d70a77f7479e883d81946660db43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:43.834955 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.835601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.837145 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1201/2388] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:43 2022] DELETE /identity/v3/projects/1795d70a77f7479e883d81946660db43 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:43.845330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:43.846639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.857256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:43.865707 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:43.866821 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.867142 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.867387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] PATH_INFO: `/v3/projects/53147bdda0d94be0b169d7dcb3a00f60` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.868629 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=53147bdda0d94be0b169d7dcb3a00f60)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:43.870525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:43.915916 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69065-d273-4049-a426-8ccc445244d1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:43.920078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53147bdda0d94be0b169d7dcb3a00f60', 'request_id': 'req-c7eeca88-b7e5-4182-a34a-777ac60b90ed'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.927613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53147bdda0d94be0b169d7dcb3a00f60', 'request_id': 'req-c7eeca88-b7e5-4182-a34a-777ac60b90ed'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.933272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53147bdda0d94be0b169d7dcb3a00f60', 'request_id': 'req-c7eeca88-b7e5-4182-a34a-777ac60b90ed'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.945667 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] The token cache is being invalidate because project 53147bdda0d94be0b169d7dcb3a00f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:43.945964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.946742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:43.948725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1188/2389] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:43 2022] DELETE /identity/v3/projects/53147bdda0d94be0b169d7dcb3a00f60 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:43.952770 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:43.954081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:43.974741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:43.975371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:43.975651 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:43.975961 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] PATH_INFO: `/v3/users/320ce8e66fae4bb6b6953a11888e8dde` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:43.977103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=320ce8e66fae4bb6b6953a11888e8dde)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:43.979018 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.028581 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:44.035441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eeca88-b7e5-4182-a34a-777ac60b90ed admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.037360 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320ce8e66fae4bb6b6953a11888e8dde'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.038065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320ce8e66fae4bb6b6953a11888e8dde'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.041085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.041741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.042259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.042626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] PATH_INFO: `/v3/users/40d7d40c78214e969b8e730a456a09d8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.043891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d7d40c78214e969b8e730a456a09d8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.046262 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.052714 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320ce8e66fae4bb6b6953a11888e8dde'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.053401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320ce8e66fae4bb6b6953a11888e8dde'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.061326 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320ce8e66fae4bb6b6953a11888e8dde'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.076500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1202/2390] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:43 2022] DELETE /identity/v3/users/320ce8e66fae4bb6b6953a11888e8dde => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:44.095964 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d7d40c78214e969b8e730a456a09d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.096595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d7d40c78214e969b8e730a456a09d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.104379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d7d40c78214e969b8e730a456a09d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.105349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d7d40c78214e969b8e730a456a09d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.119709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d7d40c78214e969b8e730a456a09d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.133272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1189/2391] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:43 2022] DELETE /identity/v3/users/40d7d40c78214e969b8e730a456a09d8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:44.407870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.409368 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:44.445780 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.447698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:44.462591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:44.498121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3766fb-307c-4c1d-b82d-e29475c48e90 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.522044 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba75f4-5988-441a-9ed5-819d1f651417 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.526776 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.527409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.527753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.528290 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] PATH_INFO: `/v3/projects/63e8a2ef4503470e9641f59305c603db` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.529504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e8a2ef4503470e9641f59305c603db)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.531579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.558875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.559506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.559791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.560468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] PATH_INFO: `/v3/projects/909e12ff326d4f8487ca9b75f70a8376` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.561608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] RBAC: Authorizing `identity:delete_project(project_id=909e12ff326d4f8487ca9b75f70a8376)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.563521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.582230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e8a2ef4503470e9641f59305c603db', 'request_id': 'req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.590288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e8a2ef4503470e9641f59305c603db', 'request_id': 'req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.596561 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e8a2ef4503470e9641f59305c603db', 'request_id': 'req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.607851 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] The token cache is being invalidate because project 63e8a2ef4503470e9641f59305c603db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:44.608212 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.608761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ea34dc14-12a9-467c-b1d0-0d68d55eb8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.610269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1190/2392] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:44 2022] DELETE /identity/v3/projects/63e8a2ef4503470e9641f59305c603db => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:44.612882 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909e12ff326d4f8487ca9b75f70a8376', 'request_id': 'req-35c40242-d119-4368-94fe-688b6ffd685b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.615339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeff57-8b4e-492f-9cfb-941e977d406d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.615632 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeff57-8b4e-492f-9cfb-941e977d406d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.615942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeff57-8b4e-492f-9cfb-941e977d406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.620900 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909e12ff326d4f8487ca9b75f70a8376', 'request_id': 'req-35c40242-d119-4368-94fe-688b6ffd685b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.625339 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:44.630836 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909e12ff326d4f8487ca9b75f70a8376', 'request_id': 'req-35c40242-d119-4368-94fe-688b6ffd685b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.638555 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-badeff57-8b4e-492f-9cfb-941e977d406d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:44.640790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-badeff57-8b4e-492f-9cfb-941e977d406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:44.642459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] The token cache is being invalidate because project 909e12ff326d4f8487ca9b75f70a8376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:44.642759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.643397 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35c40242-d119-4368-94fe-688b6ffd685b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:44.645817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1203/2393] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:44 2022] DELETE /identity/v3/projects/909e12ff326d4f8487ca9b75f70a8376 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:44.650126 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0917-e07d-40d3-955e-00fd0dbb2ce1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.650418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0917-e07d-40d3-955e-00fd0dbb2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.650700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0917-e07d-40d3-955e-00fd0dbb2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.669707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8ffd0917-e07d-40d3-955e-00fd0dbb2ce1 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:44.670906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8ffd0917-e07d-40d3-955e-00fd0dbb2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:44.699861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1191/2394] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:44.708039 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b58d6d-efb3-49a8-a39e-3675ed1999b4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.708329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b58d6d-efb3-49a8-a39e-3675ed1999b4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.708599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b58d6d-efb3-49a8-a39e-3675ed1999b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.727638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-82b58d6d-efb3-49a8-a39e-3675ed1999b4 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:44.728879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82b58d6d-efb3-49a8-a39e-3675ed1999b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:44.732073 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1204/2395] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:44.739367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f1e2-d987-4844-a20d-eb460106c6ae None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.739658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f1e2-d987-4844-a20d-eb460106c6ae None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.739968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f1e2-d987-4844-a20d-eb460106c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.741381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1192/2396] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:44.745166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b58d6d-efb3-49a8-a39e-3675ed1999b4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.754657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b58d6d-efb3-49a8-a39e-3675ed1999b4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.759759 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.759985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.760121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0f80f1e2-d987-4844-a20d-eb460106c6ae None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:44.760297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.760531 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.761173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:44.761293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0f80f1e2-d987-4844-a20d-eb460106c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:44.761473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.763053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.771365 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1205/2397] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:44.774892 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f1e2-d987-4844-a20d-eb460106c6ae None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.776758 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1193/2398] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:35:44.780755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.784855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f1e2-d987-4844-a20d-eb460106c6ae None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.790173 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.790327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77841c0f-15ac-4277-95e8-826835d33da5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.790773 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.791056 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.791333 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.792010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:44.792319 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.793913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.795076 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.795532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:44.795657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.795952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.796226 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.796846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.798725 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.809839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1206/2399] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:35:44.814341 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.825409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990cf5-b46a-473e-9f04-2bbfcd55c794 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.830235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.833754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1194/2400] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:44.833871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.833871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.833871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.833871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.834258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.834469 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.864985 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1207/2401] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:44.865871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.900638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479f0d9-cf22-44d7-a9ea-e85f5e9e717d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.928757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd1f8-6478-4f83-8e39-16d2f0e20929 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.933852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.934455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.934735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.935261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.935945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.937885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.958266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.958868 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.959149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.959418 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.960066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.963981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1208/2402] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:44.964125 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.965030 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.975153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dcdda-ad14-43bf-89d3-87a512fe9d77 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:44.980427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:44.980791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:44.981424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:44.981817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:44.982117 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:44.982851 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:44.984658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:44.987728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1195/2403] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:44 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:44.991944 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:44.995741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1209/2404] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:44.999512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.001920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa6f89-b2c3-4a1f-9ee0-c1d234c2b81d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.007400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.008030 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.008317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.008595 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.009244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.009931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f7239-9c4b-409c-83fb-0caa2ce5957a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.010839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.014639 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.015247 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.015527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.015819 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.016467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.018032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.021210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1196/2405] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:45.025449 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.028762 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1210/2406] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:45.032577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.035124 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916192e-bfe8-4938-b96a-ee1e3ce1e3c1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.039752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.040362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.040639 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.040910 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.041537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.041854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4c881-0737-443d-b339-ee2e54a2ec4a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.043098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.046488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c95f-bea4-4134-a11c-2241cdf309da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.047155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c95f-bea4-4134-a11c-2241cdf309da admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.047437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c95f-bea4-4134-a11c-2241cdf309da admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.047706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c95f-bea4-4134-a11c-2241cdf309da admin admin] PATH_INFO: `/v3/projects/0ea3d649ec494799b29ff12260a3a3c7/users/5be43fe783ba470491a49b921f76f568/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.054082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1197/2407] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:45.058207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.062860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c95f-bea4-4134-a11c-2241cdf309da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea3d649ec494799b29ff12260a3a3c7, user_id=5be43fe783ba470491a49b921f76f568, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.065536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c95f-bea4-4134-a11c-2241cdf309da admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.069003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d015a-2408-4ec3-bc50-7e7154da9a39 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.074309 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6721c-9ead-4286-8743-63daa37c8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.074953 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6721c-9ead-4286-8743-63daa37c8813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.075268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6721c-9ead-4286-8743-63daa37c8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.075542 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6721c-9ead-4286-8743-63daa37c8813 admin admin] PATH_INFO: `/v3/projects/d9b19a9bef364da68e5ac1897688b207/users/937bf4e00cb641ed9db4ef3c50a8f425/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.078969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1211/2408] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:45 2022] PUT /identity/v3/projects/0ea3d649ec494799b29ff12260a3a3c7/users/5be43fe783ba470491a49b921f76f568/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:45.090183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4844d-19d5-47d3-83be-f4d4534cf911 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.090509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4844d-19d5-47d3-83be-f4d4534cf911 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.090649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6721c-9ead-4286-8743-63daa37c8813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b19a9bef364da68e5ac1897688b207, user_id=937bf4e00cb641ed9db4ef3c50a8f425, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.090761 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4844d-19d5-47d3-83be-f4d4534cf911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.093250 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6721c-9ead-4286-8743-63daa37c8813 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.106839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1198/2409] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:45 2022] PUT /identity/v3/projects/d9b19a9bef364da68e5ac1897688b207/users/937bf4e00cb641ed9db4ef3c50a8f425/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:45.119424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed87a0-f878-482a-a9c9-301600486641 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.119636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed87a0-f878-482a-a9c9-301600486641 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.119939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-53a4844d-19d5-47d3-83be-f4d4534cf911 None None] MFA Rules not processed for user `5be43fe783ba470491a49b921f76f568`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:45.120054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed87a0-f878-482a-a9c9-301600486641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.121347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-53a4844d-19d5-47d3-83be-f4d4534cf911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:45.148674 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b7ed87a0-f878-482a-a9c9-301600486641 None None] MFA Rules not processed for user `937bf4e00cb641ed9db4ef3c50a8f425`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:45.149952 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7ed87a0-f878-482a-a9c9-301600486641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:45.186853 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1212/2410] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:45.191273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4844d-19d5-47d3-83be-f4d4534cf911 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.196138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:45.216588 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1199/2411] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:45.221597 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed87a0-f878-482a-a9c9-301600486641 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.255382 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4844d-19d5-47d3-83be-f4d4534cf911 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.260138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.260780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.261061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.261339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.261968 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.264049 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.283303 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed87a0-f878-482a-a9c9-301600486641 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.288769 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.289410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.289801 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.290080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.290711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.292453 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1213/2412] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:45.295594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.296297 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.326435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1200/2413] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:45.327401 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.358998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345a871-2839-4675-a7fc-3b571deac13d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.359464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:45.392077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5591713-2ce7-4e0a-b127-b903ff06ec96 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.396727 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.397324 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.397612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.397883 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.398535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.400479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.416401 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.417087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.417291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.417561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.418220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.420187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.426507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1201/2414] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:45.427522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.437936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86983ed9-e34a-4a93-b87f-2f57587026dc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.444902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1214/2415] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:45.445065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.445065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.445065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.445065 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.445453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.445890 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.446019 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.455396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681224d8-aa2c-4b34-940f-8f7e4f80a432 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.456069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1202/2416] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:45.459791 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.460218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.460803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.461093 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.461356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.461988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.463591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.469473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698ddd9-00b7-4add-bdb3-e7cbd9c84a79 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.477205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1215/2417] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:45.477374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.477374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.477374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.477374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.477742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.478064 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.478189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.487441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b107b-de8f-4627-b8fe-10c9042219ef admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.492302 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1203/2418] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:45.493216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.495723 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.496338 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.496615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.496911 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.497521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.499112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.503080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fd52-3848-4b60-9620-df8f86fa3838 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.507730 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390829cc-08cb-4af0-b87c-67b6b6f88b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.508421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390829cc-08cb-4af0-b87c-67b6b6f88b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.508699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390829cc-08cb-4af0-b87c-67b6b6f88b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.508968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390829cc-08cb-4af0-b87c-67b6b6f88b9a admin admin] PATH_INFO: `/v3/projects/1d184cecd1484b9e82898f1967bc925d/users/e0e06f9c2cf04a899180effbc5ec4a72/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.513193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1216/2419] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:45.513960 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.524195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0735ef-64da-4cfd-87de-dd9e38c986d1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.525065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:45.528037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390829cc-08cb-4af0-b87c-67b6b6f88b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d184cecd1484b9e82898f1967bc925d, user_id=e0e06f9c2cf04a899180effbc5ec4a72, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.530738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390829cc-08cb-4af0-b87c-67b6b6f88b9a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.530881 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d324-f976-4ae2-9def-cdb665963190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.531746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d324-f976-4ae2-9def-cdb665963190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.532519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d324-f976-4ae2-9def-cdb665963190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.533330 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d324-f976-4ae2-9def-cdb665963190 admin admin] PATH_INFO: `/v3/projects/ddee7985061148afbc663c698e7752a7/users/dfe52582ff9045e585fd7f6c23d94e09/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.545959 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1204/2420] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:45 2022] PUT /identity/v3/projects/1d184cecd1484b9e82898f1967bc925d/users/e0e06f9c2cf04a899180effbc5ec4a72/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:45.550203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d324-f976-4ae2-9def-cdb665963190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddee7985061148afbc663c698e7752a7, user_id=dfe52582ff9045e585fd7f6c23d94e09, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.553044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d324-f976-4ae2-9def-cdb665963190 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.568522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1217/2421] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:45 2022] PUT /identity/v3/projects/ddee7985061148afbc663c698e7752a7/users/dfe52582ff9045e585fd7f6c23d94e09/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:45.579509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d0898-9472-41ff-a363-d2babc919952 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.579892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d0898-9472-41ff-a363-d2babc919952 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.580128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d0898-9472-41ff-a363-d2babc919952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.611691 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-155d0898-9472-41ff-a363-d2babc919952 None None] MFA Rules not processed for user `dfe52582ff9045e585fd7f6c23d94e09`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:45.612979 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-155d0898-9472-41ff-a363-d2babc919952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:45.614553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e48d1-1a7b-4820-8e87-4be8d902e4cd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.614844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e48d1-1a7b-4820-8e87-4be8d902e4cd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.615123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e48d1-1a7b-4820-8e87-4be8d902e4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.644696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-692e48d1-1a7b-4820-8e87-4be8d902e4cd None None] MFA Rules not processed for user `e0e06f9c2cf04a899180effbc5ec4a72`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:45.645835 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-692e48d1-1a7b-4820-8e87-4be8d902e4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:45.678279 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1205/2422] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:45.682740 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d0898-9472-41ff-a363-d2babc919952 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.712420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1218/2423] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:45.716622 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e48d1-1a7b-4820-8e87-4be8d902e4cd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.744885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d0898-9472-41ff-a363-d2babc919952 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.749512 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.750119 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.750400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.750705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.751337 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.753281 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.759404 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:45.783405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e48d1-1a7b-4820-8e87-4be8d902e4cd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.788687 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1206/2424] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:45.789112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.789396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.789684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.789957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.790591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.792658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.792791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.822034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1219/2425] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:45.826090 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.857723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab022-1328-4239-a0de-415b990493c4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.884088 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:45.888928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7a7f4-0fdd-4e06-8b53-95fa8fbb62e0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.896043 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.896654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.896939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.897218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.897861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.900006 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.920706 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.921318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.921600 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.921876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.922513 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.924458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.924756 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1220/2426] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:45.925711 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.935517 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925254-6529-4321-81c0-9f3841bad436 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.940472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.941595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.941878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.942286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.942917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.944545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.946726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1207/2427] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:45 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:45.950657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.955597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1221/2428] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:45.960153 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.961166 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d802-0558-4605-a024-3ceef23b8c08 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.965788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.966379 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.966657 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.966926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.967567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.969174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.969529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e186140-af37-4b39-a989-5e38a42b3fa6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.974313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.975055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.975339 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.975614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] PATH_INFO: `/v3/projects/e18ef2a9d25942a3bbd4c7a697ea80cc/users/69f31e7b7a5b4924b56a878dedf0e5a3/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:45.979837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1208/2429] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:45.982888 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:45.991501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18ef2a9d25942a3bbd4c7a697ea80cc, user_id=69f31e7b7a5b4924b56a878dedf0e5a3, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:45.992481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811870-9464-4f19-8706-ae558aba0dce admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:45.994468 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:45.997304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:45.997938 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:45.998216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:45.998485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] PATH_INFO: `/v3/projects/98840bde4971404e9f8da9046a641ba8/users/509ff181e3ff44109bd3c512b5022200/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.012492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1222/2430] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:45 2022] PUT /identity/v3/projects/e18ef2a9d25942a3bbd4c7a697ea80cc/users/69f31e7b7a5b4924b56a878dedf0e5a3/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:46.016939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:46.022637 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98840bde4971404e9f8da9046a641ba8, user_id=509ff181e3ff44109bd3c512b5022200, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:46.025323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:46.038743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1209/2431] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:45 2022] PUT /identity/v3/projects/98840bde4971404e9f8da9046a641ba8/users/509ff181e3ff44109bd3c512b5022200/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:46.042754 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:46.080956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1671f-90ef-4099-a6cc-fd6cc5959889 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:46.094029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:46.108660 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ffe1-d331-49f2-90c2-58a3fff478c5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:46.113408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:46.114012 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.114294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.114565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.115197 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:46.116918 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:46.126644 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1210/2432] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:46.131317 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:46.139887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:46.140494 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.140774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.141002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5838891-9a86-44bb-bfe8-beec3e3f628e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:46.141114 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.141673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:46.143258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:46.146146 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44971-dc6b-4a7f-83fb-b8be4b28b958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:46.146708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44971-dc6b-4a7f-83fb-b8be4b28b958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.146991 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44971-dc6b-4a7f-83fb-b8be4b28b958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.147263 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44971-dc6b-4a7f-83fb-b8be4b28b958 admin admin] PATH_INFO: `/v3/projects/98840bde4971404e9f8da9046a641ba8/users/509ff181e3ff44109bd3c512b5022200/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.149349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b44971-dc6b-4a7f-83fb-b8be4b28b958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98840bde4971404e9f8da9046a641ba8, user_id=509ff181e3ff44109bd3c512b5022200, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:46.152151 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b44971-dc6b-4a7f-83fb-b8be4b28b958 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:46.153452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1223/2433] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:46.157483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:46.165898 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1211/2434] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:46 2022] PUT /identity/v3/projects/98840bde4971404e9f8da9046a641ba8/users/509ff181e3ff44109bd3c512b5022200/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:46.167294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d6be9-d8ed-4560-b5b8-b310194d376d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:46.176957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.177269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.177547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.206089 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] MFA Rules not processed for user `509ff181e3ff44109bd3c512b5022200`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:46.208082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:46.215503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:46.226588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda9c26-3e4f-4213-8b8f-c39c81bbabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:46.227280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9c26-3e4f-4213-8b8f-c39c81bbabd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.227564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9c26-3e4f-4213-8b8f-c39c81bbabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.227859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9c26-3e4f-4213-8b8f-c39c81bbabd9 admin admin] PATH_INFO: `/v3/projects/e18ef2a9d25942a3bbd4c7a697ea80cc/users/69f31e7b7a5b4924b56a878dedf0e5a3/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.229790 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda9c26-3e4f-4213-8b8f-c39c81bbabd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18ef2a9d25942a3bbd4c7a697ea80cc, user_id=69f31e7b7a5b4924b56a878dedf0e5a3, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:46.232447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda9c26-3e4f-4213-8b8f-c39c81bbabd9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:46.242633 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1224/2435] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:46 2022] PUT /identity/v3/projects/e18ef2a9d25942a3bbd4c7a697ea80cc/users/69f31e7b7a5b4924b56a878dedf0e5a3/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:46.252830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.253106 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.253899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.281561 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] MFA Rules not processed for user `69f31e7b7a5b4924b56a878dedf0e5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:46.281987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1212/2436] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:46.282764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:46.293064 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:46.294752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:46.353608 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1225/2437] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:46.355634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31e542-aef5-464e-9e53-c813994cceb3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:46.365228 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:46.367255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:46.406881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:46.407506 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.407789 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.408094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.423818 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66aa65-4d25-481e-a4a3-3518ba3118d7 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:46.428361 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:46.428962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:46.429242 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:46.429514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:46.435304 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:46.470912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:46.472462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:46.482425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1213/2438] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:46.487530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:46.489549 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:46.498685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1226/2439] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:47.025875 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:47.034274 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb6ef-1ac5-4b4d-84d1-58e38c43347a service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:47.038470 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:47.039149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:47.039425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:47.039757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:47.094970 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:47.096447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:47.105942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1214/2440] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:48.014794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:48.023301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aada1-8745-4874-88d9-1d5617aef902 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:48.027017 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:48.027547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:48.027855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:48.028131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:48.053014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:48.086351 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:48.087817 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:48.096919 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1227/2441] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:48.633609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:48.642011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b4126-81f2-45f2-a17f-df43ac881cef service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:48.646507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:48.647102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:48.647386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:48.647662 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:48.656753 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:48.658170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:48.668428 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1215/2442] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:51.125228 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:51.134865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3cc1c-bec1-442d-b704-4ced348005e8 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:51.138557 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44cfec-da07-4d0c-ab0a-1d2c341c2481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:51.139151 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44cfec-da07-4d0c-ab0a-1d2c341c2481 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:51.139437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44cfec-da07-4d0c-ab0a-1d2c341c2481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:51.141032 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44cfec-da07-4d0c-ab0a-1d2c341c2481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:51.197504 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44cfec-da07-4d0c-ab0a-1d2c341c2481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:51.198939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44cfec-da07-4d0c-ab0a-1d2c341c2481 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:51.208204 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1228/2443] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:52.550009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:52.612373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4def-5e21-4e1c-9e3f-0cd5eb5e7ee0 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:52.618573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:52.619199 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:52.619476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:52.619745 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] PATH_INFO: `/v3/users/937bf4e00cb641ed9db4ef3c50a8f425` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:52.620878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] RBAC: Authorizing `identity:delete_user(user_id=937bf4e00cb641ed9db4ef3c50a8f425)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:52.622774 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:52.669217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937bf4e00cb641ed9db4ef3c50a8f425'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:52.669869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937bf4e00cb641ed9db4ef3c50a8f425'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:52.672361 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:52.677866 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937bf4e00cb641ed9db4ef3c50a8f425'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:52.678488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937bf4e00cb641ed9db4ef3c50a8f425'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:52.691693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937bf4e00cb641ed9db4ef3c50a8f425'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:52.703423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1216/2444] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:52 2022] DELETE /identity/v3/users/937bf4e00cb641ed9db4ef3c50a8f425 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:52.707998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:52.708488 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:52.708590 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:52.727455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:52.728697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:52.785825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1229/2445] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:52.795453 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:52.796879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:52.853154 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ccf99-033a-4acc-a3dd-577e17eb860a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:52.856836 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:52.857434 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:52.857717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:52.857990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:52.867525 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:52.868985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:52.878234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1217/2446] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:53.154324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:53.155739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:53.182474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75b9dc-fbdd-41fd-9ad9-63c21e53840e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:53.187823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:53.188460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:53.188729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:53.189054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] PATH_INFO: `/v3/projects/d9b19a9bef364da68e5ac1897688b207` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:53.190177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b19a9bef364da68e5ac1897688b207)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:53.192189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:53.239772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b19a9bef364da68e5ac1897688b207', 'request_id': 'req-e4ea22c5-f565-4512-9721-449bb1874cb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.247071 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b19a9bef364da68e5ac1897688b207', 'request_id': 'req-e4ea22c5-f565-4512-9721-449bb1874cb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.251109 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:53.254537 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b19a9bef364da68e5ac1897688b207', 'request_id': 'req-e4ea22c5-f565-4512-9721-449bb1874cb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.267316 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] The token cache is being invalidate because project d9b19a9bef364da68e5ac1897688b207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:53.267615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.268272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.270657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1230/2447] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:53 2022] DELETE /identity/v3/projects/d9b19a9bef364da68e5ac1897688b207 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:53.274661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:53.285902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1c0c2-3dfa-4c70-aa0a-f3de6e731a1e service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:53.332586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:53.334103 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:53.344117 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:53.344744 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:53.345016 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:53.345291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] PATH_INFO: `/v3/users/e0e06f9c2cf04a899180effbc5ec4a72` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:53.346400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e06f9c2cf04a899180effbc5ec4a72)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:53.348879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:53.398902 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e06f9c2cf04a899180effbc5ec4a72'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.399626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e06f9c2cf04a899180effbc5ec4a72'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.399734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea22c5-f565-4512-9721-449bb1874cb3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:53.404356 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:53.404977 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:53.405290 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:53.405550 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] PATH_INFO: `/v3/users/5be43fe783ba470491a49b921f76f568` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:53.406824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be43fe783ba470491a49b921f76f568)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:53.408678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e06f9c2cf04a899180effbc5ec4a72'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.408810 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:53.409511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e06f9c2cf04a899180effbc5ec4a72'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.422980 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-81d5b398-fac9-4dd2-aca2-017b531a56a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e06f9c2cf04a899180effbc5ec4a72'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.424474 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:53.440097 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1218/2448] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:53 2022] DELETE /identity/v3/users/e0e06f9c2cf04a899180effbc5ec4a72 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:53.461954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be43fe783ba470491a49b921f76f568'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.462614 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be43fe783ba470491a49b921f76f568'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.474673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be43fe783ba470491a49b921f76f568'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.475349 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be43fe783ba470491a49b921f76f568'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.483087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be43fe783ba470491a49b921f76f568'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.496133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1231/2449] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:53 2022] DELETE /identity/v3/users/5be43fe783ba470491a49b921f76f568 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:53.501251 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:53.501543 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:53.501819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:53.523246 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:53.524509 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:53.585329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1219/2450] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:53.599165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:53.600843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:53.662470 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5dc9a-a5e9-4a26-9cb6-a37bc533440a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:53.667304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:53.668027 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:53.668369 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:53.668707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:53.678273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:53.679706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:53.689519 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1232/2451] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:35:53.745003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:53.746882 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:53.764107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f664bd7-358e-4bf0-ae00-330757aa129c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:53.771690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:53.772893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:53.773159 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:53.773466 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] PATH_INFO: `/v3/projects/1d184cecd1484b9e82898f1967bc925d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:53.775877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d184cecd1484b9e82898f1967bc925d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:53.781353 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:53.836376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d184cecd1484b9e82898f1967bc925d', 'request_id': 'req-d899ebe2-b1fd-47db-b176-9e45903130ef'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.843932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d184cecd1484b9e82898f1967bc925d', 'request_id': 'req-d899ebe2-b1fd-47db-b176-9e45903130ef'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.849763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d184cecd1484b9e82898f1967bc925d', 'request_id': 'req-d899ebe2-b1fd-47db-b176-9e45903130ef'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.860999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] The token cache is being invalidate because project 1d184cecd1484b9e82898f1967bc925d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:53.861653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.861961 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.864261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1220/2452] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:53 2022] DELETE /identity/v3/projects/1d184cecd1484b9e82898f1967bc925d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:53.868217 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:53.879008 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46b46-74b7-4af8-9fa4-a165fe8d99bf service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:53.884757 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:53.941388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:53.941988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:53.942270 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:53.942543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] PATH_INFO: `/v3/users/69f31e7b7a5b4924b56a878dedf0e5a3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:53.943673 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f31e7b7a5b4924b56a878dedf0e5a3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:53.945831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:53.991187 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:53.993429 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:53.993991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f31e7b7a5b4924b56a878dedf0e5a3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:53.994798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f31e7b7a5b4924b56a878dedf0e5a3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.008861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f31e7b7a5b4924b56a878dedf0e5a3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.009648 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f31e7b7a5b4924b56a878dedf0e5a3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.012148 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ebe2-b1fd-47db-b176-9e45903130ef admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.018217 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.018897 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.019201 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.019383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f31e7b7a5b4924b56a878dedf0e5a3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.019606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] PATH_INFO: `/v3/projects/0ea3d649ec494799b29ff12260a3a3c7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.020723 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea3d649ec494799b29ff12260a3a3c7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.022651 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.034962 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1233/2453] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:53 2022] DELETE /identity/v3/users/69f31e7b7a5b4924b56a878dedf0e5a3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:54.072751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea3d649ec494799b29ff12260a3a3c7', 'request_id': 'req-25c55b6e-9c5e-4d82-8ea5-787525f70f95'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.081473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea3d649ec494799b29ff12260a3a3c7', 'request_id': 'req-25c55b6e-9c5e-4d82-8ea5-787525f70f95'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.087613 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea3d649ec494799b29ff12260a3a3c7', 'request_id': 'req-25c55b6e-9c5e-4d82-8ea5-787525f70f95'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.089579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:54.102598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] The token cache is being invalidate because project 0ea3d649ec494799b29ff12260a3a3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:54.102782 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.103424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.104966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1221/2454] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:53 2022] DELETE /identity/v3/projects/0ea3d649ec494799b29ff12260a3a3c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:54.108970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.110393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.177582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba54b7-ceab-4431-b7ee-f4714c1d1089 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.220329 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:54.248261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.248932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.249213 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.249507 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] PATH_INFO: `/v3/users/dfe52582ff9045e585fd7f6c23d94e09` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.250647 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe52582ff9045e585fd7f6c23d94e09)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.252657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.300618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe52582ff9045e585fd7f6c23d94e09'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.301532 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe52582ff9045e585fd7f6c23d94e09'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.308133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.309625 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.321760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe52582ff9045e585fd7f6c23d94e09'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.322849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe52582ff9045e585fd7f6c23d94e09'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.324709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55b6e-9c5e-4d82-8ea5-787525f70f95 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.331043 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.332577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.332784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3569dfad-7928-4183-82a7-6fbf58728292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe52582ff9045e585fd7f6c23d94e09'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.332908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.333123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] PATH_INFO: `/v3/projects/e18ef2a9d25942a3bbd4c7a697ea80cc` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.334638 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18ef2a9d25942a3bbd4c7a697ea80cc)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.337155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.348996 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1234/2455] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:54 2022] DELETE /identity/v3/users/dfe52582ff9045e585fd7f6c23d94e09 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:35:54.387945 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18ef2a9d25942a3bbd4c7a697ea80cc', 'request_id': 'req-9a12f200-1079-4996-8cae-26b5fedfa61c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.396476 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18ef2a9d25942a3bbd4c7a697ea80cc', 'request_id': 'req-9a12f200-1079-4996-8cae-26b5fedfa61c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.402305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18ef2a9d25942a3bbd4c7a697ea80cc', 'request_id': 'req-9a12f200-1079-4996-8cae-26b5fedfa61c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.414680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] The token cache is being invalidate because project e18ef2a9d25942a3bbd4c7a697ea80cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:54.415127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.415647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9a12f200-1079-4996-8cae-26b5fedfa61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.417254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1222/2456] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:54 2022] DELETE /identity/v3/projects/e18ef2a9d25942a3bbd4c7a697ea80cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:54.422306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498b15d-bc67-476c-90cb-4abd3cf6cced None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.422700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498b15d-bc67-476c-90cb-4abd3cf6cced None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.423082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498b15d-bc67-476c-90cb-4abd3cf6cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.444291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9498b15d-bc67-476c-90cb-4abd3cf6cced None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:54.445518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9498b15d-bc67-476c-90cb-4abd3cf6cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.509909 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1235/2457] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:54.518904 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938b16-15ac-441b-9896-665c98ea9d06 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.519602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938b16-15ac-441b-9896-665c98ea9d06 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.519911 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938b16-15ac-441b-9896-665c98ea9d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.540091 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9d938b16-15ac-441b-9896-665c98ea9d06 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:54.541301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9d938b16-15ac-441b-9896-665c98ea9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.549738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1223/2458] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:54.554803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498b15d-bc67-476c-90cb-4abd3cf6cced None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.565195 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498b15d-bc67-476c-90cb-4abd3cf6cced None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.570824 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.571425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.571705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.572081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.572735 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:35:54.573086 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.574654 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.586666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1236/2459] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:35:54.591080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d938b16-15ac-441b-9896-665c98ea9d06 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.600746 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d938b16-15ac-441b-9896-665c98ea9d06 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.606078 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.606682 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.606965 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.607239 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.607924 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.609880 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.632483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.634433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.647736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1224/2460] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:35:54 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:35:54.648839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.652118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db567-f83b-4e95-9c71-5cf41800316c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.697472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:54.715321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.715978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.716088 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cb3f-9d4f-4e91-8000-bcfca0d60df1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.716262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.716538 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] PATH_INFO: `/v3/projects/ddee7985061148afbc663c698e7752a7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.717829 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddee7985061148afbc663c698e7752a7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.719739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.720778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.721387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.721672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.721976 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.722606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.724550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.746185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1225/2461] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:35:54 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:35:54.750427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.761062 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22661d-bdad-458c-9109-fd2da8b7eea2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.773150 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddee7985061148afbc663c698e7752a7', 'request_id': 'req-bb44fcea-9611-4597-a162-a0ddb5433f8f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.779870 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddee7985061148afbc663c698e7752a7', 'request_id': 'req-bb44fcea-9611-4597-a162-a0ddb5433f8f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.787582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddee7985061148afbc663c698e7752a7', 'request_id': 'req-bb44fcea-9611-4597-a162-a0ddb5433f8f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.798398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] The token cache is being invalidate because project ddee7985061148afbc663c698e7752a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:54.798710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.799370 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.799537 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:54.801466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1237/2462] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:54 2022] DELETE /identity/v3/projects/ddee7985061148afbc663c698e7752a7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:54.805495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.807002 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.820761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.821424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.821708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.821987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.822636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.824369 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.834213 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1226/2463] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:54.838139 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.839778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.851906 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e28ca-5ac1-4b63-b031-03900489b308 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.856823 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.857520 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.857809 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.858085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.858756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.860378 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.871218 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44fcea-9611-4597-a162-a0ddb5433f8f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.872419 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1227/2464] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:35:54.876240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.876665 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.876868 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.877197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.877473 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] PATH_INFO: `/v3/users/509ff181e3ff44109bd3c512b5022200` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.879190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509ff181e3ff44109bd3c512b5022200)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.881159 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.887066 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc512c-8ef1-4463-81b0-eb5b02c1a1e0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.891837 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a37b37-2fb7-4e6c-b1d5-d1f7cd0613b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.892473 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a37b37-2fb7-4e6c-b1d5-d1f7cd0613b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.892751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a37b37-2fb7-4e6c-b1d5-d1f7cd0613b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.893022 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a37b37-2fb7-4e6c-b1d5-d1f7cd0613b4 admin admin] PATH_INFO: `/v3/projects/1988b6e325a84f89af53ec7154e36145/users/175d180996b04b5d847c97c7e0190eb9/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.908768 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a37b37-2fb7-4e6c-b1d5-d1f7cd0613b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1988b6e325a84f89af53ec7154e36145, user_id=175d180996b04b5d847c97c7e0190eb9, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.912093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a37b37-2fb7-4e6c-b1d5-d1f7cd0613b4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.926458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1228/2465] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:35:54 2022] PUT /identity/v3/projects/1988b6e325a84f89af53ec7154e36145/users/175d180996b04b5d847c97c7e0190eb9/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:54.929686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509ff181e3ff44109bd3c512b5022200'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.930353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509ff181e3ff44109bd3c512b5022200'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.937210 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.937501 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.937783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.943917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509ff181e3ff44109bd3c512b5022200'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.944636 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509ff181e3ff44109bd3c512b5022200'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.952645 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509ff181e3ff44109bd3c512b5022200'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:54.954791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:54.966763 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] MFA Rules not processed for user `175d180996b04b5d847c97c7e0190eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:54.968005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.968429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1238/2466] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:35:54 2022] DELETE /identity/v3/users/509ff181e3ff44109bd3c512b5022200 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:35:55.035228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1229/2467] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:55.046323 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:55.047770 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:55.107521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e5e29-e475-47be-aadc-7a0b5339b939 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:55.111130 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:55.111774 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:55.112076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:55.112343 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:55.121583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:55.123015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:55.132388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1239/2468] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:55.256077 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:55.258194 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:55.348045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e200a-1666-4402-adbf-32c0c98a4251 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:55.353475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:55.354265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:55.354546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:55.354879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] PATH_INFO: `/v3/projects/98840bde4971404e9f8da9046a641ba8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:55.356320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98840bde4971404e9f8da9046a641ba8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:55.358643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:55.401356 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:55.420208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98840bde4971404e9f8da9046a641ba8', 'request_id': 'req-2899627e-44b6-4668-88f1-30d35ac67f7f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:55.428947 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98840bde4971404e9f8da9046a641ba8', 'request_id': 'req-2899627e-44b6-4668-88f1-30d35ac67f7f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:55.435818 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98840bde4971404e9f8da9046a641ba8', 'request_id': 'req-2899627e-44b6-4668-88f1-30d35ac67f7f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:55.450233 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] The token cache is being invalidate because project 98840bde4971404e9f8da9046a641ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:35:55.450892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:55.451564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:35:55.453939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1230/2469] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:35:55 2022] DELETE /identity/v3/projects/98840bde4971404e9f8da9046a641ba8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:36:03.932931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:03.934320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:03.990871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75ed84-decf-480a-b548-48bf6d8b5758 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:04.041830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c570-c323-420f-a2e7-262dad7ca41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:04.042432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c570-c323-420f-a2e7-262dad7ca41d service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:04.042759 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c570-c323-420f-a2e7-262dad7ca41d service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:04.042964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c570-c323-420f-a2e7-262dad7ca41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:04.044809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f823c570-c323-420f-a2e7-262dad7ca41d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:04.112408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823c570-c323-420f-a2e7-262dad7ca41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:04.113843 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823c570-c323-420f-a2e7-262dad7ca41d service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:04.119601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:04.125076 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1240/2470] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:36:05.172494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:05.173928 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:05.186907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899627e-44b6-4668-88f1-30d35ac67f7f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:05.191442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:05.192098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:05.192368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:05.192647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] PATH_INFO: `/v3/users/175d180996b04b5d847c97c7e0190eb9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:05.193736 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175d180996b04b5d847c97c7e0190eb9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:05.195621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:05.249437 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175d180996b04b5d847c97c7e0190eb9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.250312 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175d180996b04b5d847c97c7e0190eb9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.258756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175d180996b04b5d847c97c7e0190eb9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.260358 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175d180996b04b5d847c97c7e0190eb9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.279477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175d180996b04b5d847c97c7e0190eb9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.296074 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1231/2471] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:36:05 2022] DELETE /identity/v3/users/175d180996b04b5d847c97c7e0190eb9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:36:05.300675 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:05.301549 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:05.301834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:05.323837 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:05.325143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:05.397432 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1241/2472] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:05.406999 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:05.408465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:05.480822 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dbe97-7539-4e68-97a7-342fe7d896d3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:05.485677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:05.486342 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:05.486623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:05.486891 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:05.501011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:05.503643 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:05.512849 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1232/2473] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:36:05.819572 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:05.821220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:05.840099 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b09d-898e-4666-a2dd-98eb811f3c5a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:05.853231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:05.853939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:05.854148 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:05.854418 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] PATH_INFO: `/v3/projects/1988b6e325a84f89af53ec7154e36145` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:05.860799 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1988b6e325a84f89af53ec7154e36145)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:05.863901 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:05.930697 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1988b6e325a84f89af53ec7154e36145', 'request_id': 'req-6b91b8cc-1462-4ec0-9c39-780af109c299'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.940601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1988b6e325a84f89af53ec7154e36145', 'request_id': 'req-6b91b8cc-1462-4ec0-9c39-780af109c299'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.952907 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1988b6e325a84f89af53ec7154e36145', 'request_id': 'req-6b91b8cc-1462-4ec0-9c39-780af109c299'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.972644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] The token cache is being invalidate because project 1988b6e325a84f89af53ec7154e36145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:36:05.973124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.973809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:05.984336 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1242/2474] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:36:05 2022] DELETE /identity/v3/projects/1988b6e325a84f89af53ec7154e36145 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:36:07.389011 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:07.390522 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:07.413351 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d395-bea2-41a7-81de-2c47e04fc354 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:07.450173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:07.477932 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:07.478566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:07.478853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:07.479131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] PATH_INFO: `/v3/users/f83067d716e74d69bdffadb7e6c2ff6a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:07.480338 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83067d716e74d69bdffadb7e6c2ff6a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:07.482289 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:07.534573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83067d716e74d69bdffadb7e6c2ff6a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.535368 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83067d716e74d69bdffadb7e6c2ff6a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.543783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83067d716e74d69bdffadb7e6c2ff6a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.544800 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83067d716e74d69bdffadb7e6c2ff6a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.558314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-39b27482-11da-46ee-8e4a-543452acc5a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83067d716e74d69bdffadb7e6c2ff6a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.571230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1233/2475] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:36:07 2022] DELETE /identity/v3/users/f83067d716e74d69bdffadb7e6c2ff6a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:36:07.743328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:07.744767 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:07.758964 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b8cc-1462-4ec0-9c39-780af109c299 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:07.817747 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:07.818371 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:07.818657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:07.818928 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] PATH_INFO: `/v3/projects/71c102fa939940e09cd0313c7eb543f6` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:07.820063 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c102fa939940e09cd0313c7eb543f6)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:07.821954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:07.851402 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:07.868119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c102fa939940e09cd0313c7eb543f6', 'request_id': 'req-cef561f0-dece-40a8-95a9-242afc1d1cd2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.874177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c102fa939940e09cd0313c7eb543f6', 'request_id': 'req-cef561f0-dece-40a8-95a9-242afc1d1cd2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.881969 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c102fa939940e09cd0313c7eb543f6', 'request_id': 'req-cef561f0-dece-40a8-95a9-242afc1d1cd2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.892036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] The token cache is being invalidate because project 71c102fa939940e09cd0313c7eb543f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:36:07.892321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.892935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cef561f0-dece-40a8-95a9-242afc1d1cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:07.895011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1243/2476] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:36:07 2022] DELETE /identity/v3/projects/71c102fa939940e09cd0313c7eb543f6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:36:07.900050 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387161-cefb-4347-a3f8-3eede60d2e42 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:07.900346 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387161-cefb-4347-a3f8-3eede60d2e42 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:07.900654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387161-cefb-4347-a3f8-3eede60d2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:07.920308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-84387161-cefb-4347-a3f8-3eede60d2e42 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:07.921551 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-84387161-cefb-4347-a3f8-3eede60d2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:07.979895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1234/2477] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:07.987665 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172da65-6c25-4666-9c30-1f4c115af536 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:07.987979 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172da65-6c25-4666-9c30-1f4c115af536 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:07.988254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172da65-6c25-4666-9c30-1f4c115af536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.008180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b172da65-6c25-4666-9c30-1f4c115af536 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:08.009375 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b172da65-6c25-4666-9c30-1f4c115af536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:08.017458 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1244/2478] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:08.022189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84387161-cefb-4347-a3f8-3eede60d2e42 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:08.031622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84387161-cefb-4347-a3f8-3eede60d2e42 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:08.036173 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:08.036760 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.037037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.037308 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.037946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:36:08.038247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:08.039845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:08.051616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1235/2479] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:36:08.055760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172da65-6c25-4666-9c30-1f4c115af536 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:08.065029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172da65-6c25-4666-9c30-1f4c115af536 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:08.069755 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:08.070281 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.070559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.070830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.071447 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:08.073396 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:08.100239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1245/2480] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:36:08 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:36:08.104242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:08.114621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49c40b-e1f7-4278-ac7d-ff5f095bae62 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:08.155845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:08.173208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:08.173808 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.174087 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.174360 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.175493 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:08.177421 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:08.199452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1236/2481] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:36:08 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:36:08.203709 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:08.213933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98e3f0-bb50-4e8e-ae58-f0e7727c1cc9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:08.218789 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:08.219379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.219657 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.219971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.220674 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:08.222251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:08.231833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1246/2482] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:36:08.235650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:08.245881 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5326d4-30eb-447e-b142-6f2e5115e21b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:08.250528 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7da64-370e-4d23-9cb6-9bfab340fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:08.251109 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7da64-370e-4d23-9cb6-9bfab340fe99 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.251390 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7da64-370e-4d23-9cb6-9bfab340fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.251663 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7da64-370e-4d23-9cb6-9bfab340fe99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.252334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7da64-370e-4d23-9cb6-9bfab340fe99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:08.254005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7da64-370e-4d23-9cb6-9bfab340fe99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:08.264877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1237/2483] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:36:08.269628 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:08.279379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf11f-abcb-4db1-befa-906575603835 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:08.284690 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:08.285320 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.285597 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.285866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] PATH_INFO: `/v3/projects/4f06f59d05f144d687979666ed27d61a/users/2bc0b1473b4b4970b6eb76368260850d/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.299863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f06f59d05f144d687979666ed27d61a, user_id=2bc0b1473b4b4970b6eb76368260850d, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:08.302476 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:08.315540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1247/2484] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:36:08 2022] PUT /identity/v3/projects/4f06f59d05f144d687979666ed27d61a/users/2bc0b1473b4b4970b6eb76368260850d/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:36:08.320713 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744bdb-77b5-4105-ac6d-bdd8b0448fe3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.320939 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744bdb-77b5-4105-ac6d-bdd8b0448fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.321209 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744bdb-77b5-4105-ac6d-bdd8b0448fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.340147 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-66744bdb-77b5-4105-ac6d-bdd8b0448fe3 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:08.341334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-66744bdb-77b5-4105-ac6d-bdd8b0448fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:08.399617 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1238/2485] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:08.409193 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:08.410871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:08.468791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97da73-be77-440f-8b3a-542628f15fa5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:08.472385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:08.472975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:08.473254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:08.473523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:08.482124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:08.483545 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:08.492696 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1248/2486] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:12.595265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9265-9f86-465a-805e-3406a462db4b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:12.595834 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9265-9f86-465a-805e-3406a462db4b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:12.595934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9265-9f86-465a-805e-3406a462db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:12.626344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-73db9265-9f86-465a-805e-3406a462db4b None None] MFA Rules not processed for user `2bc0b1473b4b4970b6eb76368260850d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:12.627578 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-73db9265-9f86-465a-805e-3406a462db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:12.713785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1239/2487] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:36:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:12.728784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:12.730798 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:12.799834 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:12.825014 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444811-d188-46cb-819d-337a37a4bf5d service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:12.831378 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:12.832033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:12.832313 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:12.832585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:12.841957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:12.843698 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:12.855495 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1249/2488] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:14.134728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a213-1c21-4e5d-abe8-c5fa1f6f656a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:14.135223 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a213-1c21-4e5d-abe8-c5fa1f6f656a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:14.135341 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a213-1c21-4e5d-abe8-c5fa1f6f656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:14.155477 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7779a213-1c21-4e5d-abe8-c5fa1f6f656a None None] MFA Rules not processed for user `2bc0b1473b4b4970b6eb76368260850d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:14.156708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7779a213-1c21-4e5d-abe8-c5fa1f6f656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:14.164323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1240/2489] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:36:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:14.475689 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:14.484927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3ad3-ac10-4cc1-8317-394cdea23a36 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:14.488533 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:14.489123 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:14.489405 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:14.489681 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:14.491419 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:14.500935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:14.502874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:14.511053 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1250/2490] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:18.086094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a213-1c21-4e5d-abe8-c5fa1f6f656a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:18.095669 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a213-1c21-4e5d-abe8-c5fa1f6f656a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:18.099264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:18.099895 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:18.100179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:18.100451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:18.102162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:18.149362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:18.167545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:18.169008 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:18.178594 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1241/2491] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:19.089044 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:19.103264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702e6f-b4ef-47ac-82e7-2804b934bd10 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:19.111189 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:19.111874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:19.112155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:19.112467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:19.114272 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:19.130305 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:19.131999 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:19.145982 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1251/2492] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:23.028141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:23.029554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:23.040533 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679b1c4-6d4c-48f9-bbd4-88f9555960c1 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:23.044174 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:23.045034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:23.045314 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:23.045590 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:23.047292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:23.059624 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:23.061355 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:23.071783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1242/2493] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:26.558118 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:26.559514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:26.635291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa432a-9195-49bf-97c0-07929e181cce service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:26.641301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:26.641913 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:26.642197 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:26.642503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:26.644857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:26.657859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:26.659844 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:26.670045 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1252/2494] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:29.917286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:29.918098 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:29.930712 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa9f72-137f-4fae-b763-6ee0f1a0c4ef service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:29.935728 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:29.936455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:29.936735 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:29.937006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] PATH_INFO: `/v3/users/0934e658da474331a8a16d07d465cfcd` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:29.938107 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0934e658da474331a8a16d07d465cfcd)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:29.940058 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:29.988127 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0934e658da474331a8a16d07d465cfcd'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:29.988787 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0934e658da474331a8a16d07d465cfcd'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:29.995692 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0934e658da474331a8a16d07d465cfcd'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:29.996364 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0934e658da474331a8a16d07d465cfcd'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.008756 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0934e658da474331a8a16d07d465cfcd'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.021439 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1243/2495] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:36:29 2022] DELETE /identity/v3/users/0934e658da474331a8a16d07d465cfcd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:36:30.199461 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:30.212388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ad9c-1d97-4bfc-8431-7b29e7762d59 service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:30.269758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:30.270379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:30.270661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:30.270933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] PATH_INFO: `/v3/projects/4d37a219659b482e874cd6d5c0384461` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:30.272070 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d37a219659b482e874cd6d5c0384461)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:30.273959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:30.317081 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:30.321568 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d37a219659b482e874cd6d5c0384461', 'request_id': 'req-d73911e1-015b-49aa-9715-b032cf4852ac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.328231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d37a219659b482e874cd6d5c0384461', 'request_id': 'req-d73911e1-015b-49aa-9715-b032cf4852ac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.335434 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d37a219659b482e874cd6d5c0384461', 'request_id': 'req-d73911e1-015b-49aa-9715-b032cf4852ac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.346137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] The token cache is being invalidate because project 4d37a219659b482e874cd6d5c0384461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:36:30.346425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.347052 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.348574 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1253/2496] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:36:30 2022] DELETE /identity/v3/projects/4d37a219659b482e874cd6d5c0384461 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:36:30.352602 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:30.354003 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:30.367538 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b194ce-0547-4ba4-87e7-0bbc3297d044 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:30.422497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:30.423128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:30.423413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:30.424271 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] PATH_INFO: `/v3/users/b2cd25fa1da441be904ddf703ecdfd5b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:30.425482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2cd25fa1da441be904ddf703ecdfd5b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:30.427395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:30.472340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:30.475244 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2cd25fa1da441be904ddf703ecdfd5b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.476424 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2cd25fa1da441be904ddf703ecdfd5b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.484997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2cd25fa1da441be904ddf703ecdfd5b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.485612 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2cd25fa1da441be904ddf703ecdfd5b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.498403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6ff34ac7-99f2-4b1d-b3f6-577460d34043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2cd25fa1da441be904ddf703ecdfd5b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.510410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1244/2497] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:36:30 2022] DELETE /identity/v3/users/b2cd25fa1da441be904ddf703ecdfd5b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:36:30.681355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:30.682905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:30.707395 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73911e1-015b-49aa-9715-b032cf4852ac admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:30.769634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:30.770278 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:30.770556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:30.770830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] PATH_INFO: `/v3/projects/b4d88e64058e4273a11b86902ea82214` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:30.772026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d88e64058e4273a11b86902ea82214)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:30.773965 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:30.839042 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d88e64058e4273a11b86902ea82214', 'request_id': 'req-1d032a42-98f4-44a5-8b5a-dcf29856891f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.850137 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d88e64058e4273a11b86902ea82214', 'request_id': 'req-1d032a42-98f4-44a5-8b5a-dcf29856891f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.860240 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d88e64058e4273a11b86902ea82214', 'request_id': 'req-1d032a42-98f4-44a5-8b5a-dcf29856891f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.873485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] The token cache is being invalidate because project b4d88e64058e4273a11b86902ea82214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:36:30.873779 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.874437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:36:30.876379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1254/2498] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:36:30 2022] DELETE /identity/v3/projects/b4d88e64058e4273a11b86902ea82214 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:36:40.506892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:40.870124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:10.039946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:10.040463 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:10.040585 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:10.069113 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] MFA Rules not processed for user `2bc0b1473b4b4970b6eb76368260850d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:37:10.070344 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:10.142452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1245/2499] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:37:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:37:10.444828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:10.446324 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:10.538831 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d032a42-98f4-44a5-8b5a-dcf29856891f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:10.542481 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb24684-8ba9-4397-a8e3-28348fc36d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:10.543072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24684-8ba9-4397-a8e3-28348fc36d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:10.543347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24684-8ba9-4397-a8e3-28348fc36d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:10.543618 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24684-8ba9-4397-a8e3-28348fc36d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:10.545309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1bb24684-8ba9-4397-a8e3-28348fc36d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:10.554993 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb24684-8ba9-4397-a8e3-28348fc36d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:10.556445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb24684-8ba9-4397-a8e3-28348fc36d2f service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:10.564425 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1255/2500] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:37:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:37:16.416670 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:16.418085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:16.514518 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd357a-5bbd-41bd-8a33-66ba3cf950dd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:16.519691 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:16.520340 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:16.520621 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:16.520893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:16.522583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:16.533626 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:16.535182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:16.545386 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1246/2501] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:37:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:37:20.560935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=44 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:26.541165 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:15.137765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:38:15.138284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:38:15.138399 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:38:15.157467 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] MFA Rules not processed for user `2bc0b1473b4b4970b6eb76368260850d`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:38:15.158646 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:38:15.165859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1256/2502] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:38:25.152733 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:02.729785 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:02.731184 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:02.809925 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5484-8f7b-47f9-8e75-91c3e08ae6c0 service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:02.813569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8ea53-3dee-485a-b23d-f426b7eb3121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:02.814163 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ea53-3dee-485a-b23d-f426b7eb3121 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:02.814445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ea53-3dee-485a-b23d-f426b7eb3121 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:02.814718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ea53-3dee-485a-b23d-f426b7eb3121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:02.816442 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8bc8ea53-3dee-485a-b23d-f426b7eb3121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:02.906967 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8ea53-3dee-485a-b23d-f426b7eb3121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:02.908372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8ea53-3dee-485a-b23d-f426b7eb3121 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:02.928794 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1247/2503] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:05.454929 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:05.456352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:05.468703 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29186378-9eaa-4480-b18c-dc7549dd9a7a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:05.472166 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:05.472752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:05.473029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:05.473294 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:05.475496 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:05.488353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:05.489769 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:05.500334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1257/2504] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:12.667933 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:12.668464 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:12.668591 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:12.688547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] MFA Rules not processed for user `2bc0b1473b4b4970b6eb76368260850d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:12.689752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:12.696610 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1248/2505] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:15.495526 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:22.682912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=78 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:01.352459 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:01.354287 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:01.371262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c894-5097-4d2d-ac90-41dcc0ff9700 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:01.377132 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:01.377802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:01.378082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:01.378441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:01.380995 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:01.391975 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:01.393413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:01.401554 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1258/2506] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:08.257288 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:08.259343 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:08.277574 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5d32c-7f13-4784-a0bc-57a1c0756cc2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:08.283712 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01495a37066445293bdb957ece67e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:08.284359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:08.284641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:08.285100 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:08.287234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:08.300422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:08.302046 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:08.313751 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1249/2507] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:11.397874 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:17.145797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:17.147988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:17.163619 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c888f0-f874-48b6-bce6-2638c1fe2126 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:17.169304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:17.169905 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:17.170188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:17.170460 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:17.172236 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:17.184415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:17.186010 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:17.196474 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1259/2508] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:17.212115 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:17.214457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:17.325583 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad3e98-6626-4c8d-aab1-3e61e90d0375 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:17.330272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:17.330900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:17.331182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:17.331462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] PATH_INFO: `/v3/users/2bc0b1473b4b4970b6eb76368260850d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:17.332647 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc0b1473b4b4970b6eb76368260850d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:17.334864 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:17.385297 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc0b1473b4b4970b6eb76368260850d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.385975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc0b1473b4b4970b6eb76368260850d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.394060 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc0b1473b4b4970b6eb76368260850d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.394992 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc0b1473b4b4970b6eb76368260850d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.407914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-572ada15-cd73-492e-b877-18bfbc4be36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc0b1473b4b4970b6eb76368260850d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.422215 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1250/2509] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:17 2022] DELETE /identity/v3/users/2bc0b1473b4b4970b6eb76368260850d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:17.591275 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:17.601899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88559ada-fee0-42b1-8847-87e23d3d94e7 service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:17.659376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:17.660026 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:17.660307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:17.660576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] PATH_INFO: `/v3/projects/4f06f59d05f144d687979666ed27d61a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:17.661684 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f06f59d05f144d687979666ed27d61a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:17.663729 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:17.709268 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f06f59d05f144d687979666ed27d61a', 'request_id': 'req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.715322 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f06f59d05f144d687979666ed27d61a', 'request_id': 'req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.722881 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f06f59d05f144d687979666ed27d61a', 'request_id': 'req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.733734 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] The token cache is being invalidate because project 4f06f59d05f144d687979666ed27d61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:17.734016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.734626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dd3a0524-e50b-4d1a-bbee-ad15c0db0143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:17.736134 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1260/2510] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:17 2022] DELETE /identity/v3/projects/4f06f59d05f144d687979666ed27d61a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:17.741112 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a63d-611f-48c1-b143-15a9f8462ba8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:17.741403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a63d-611f-48c1-b143-15a9f8462ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:17.741680 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6a63d-611f-48c1-b143-15a9f8462ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:17.797048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:17.800075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-78e6a63d-611f-48c1-b143-15a9f8462ba8 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:17.802083 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-78e6a63d-611f-48c1-b143-15a9f8462ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:17.862114 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1251/2511] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:17.869833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ed04-c481-4bed-9c6d-8661d964831d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:17.870119 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ed04-c481-4bed-9c6d-8661d964831d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:17.870393 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ed04-c481-4bed-9c6d-8661d964831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:17.889695 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4722ed04-c481-4bed-9c6d-8661d964831d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:17.890878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4722ed04-c481-4bed-9c6d-8661d964831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:17.898624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1261/2512] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:17.903172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6a63d-611f-48c1-b143-15a9f8462ba8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:17.912802 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6a63d-611f-48c1-b143-15a9f8462ba8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:17.917907 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:17.918499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:17.918778 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:17.919047 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:17.919685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:40:17.920015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:17.921623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:17.933176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1252/2513] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:40:17.937282 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ed04-c481-4bed-9c6d-8661d964831d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:17.946226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ed04-c481-4bed-9c6d-8661d964831d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:17.950847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:17.951439 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:17.951719 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:17.952022 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:17.952649 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:17.954527 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:17.990190 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1262/2514] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:17 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:40:17.994167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.004075 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e8ad-32ea-4885-a748-67c7c22d19f0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.059192 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.059869 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.060170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.060445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.061082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.062993 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.083425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1253/2515] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:17 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:40:18.088061 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.098293 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb8e59-6b3f-475c-b637-1890e4d6e5be admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.103511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.104149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.104435 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.104708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.105347 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.106946 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.116679 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1263/2516] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:18.120448 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.130389 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cabd3-2901-4413-b8e9-9cc31b1e9ab1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.135461 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d31337-ddc7-4ba1-8626-f6dbfe0e92ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.136082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31337-ddc7-4ba1-8626-f6dbfe0e92ba admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.136359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31337-ddc7-4ba1-8626-f6dbfe0e92ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.136627 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31337-ddc7-4ba1-8626-f6dbfe0e92ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.137258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d31337-ddc7-4ba1-8626-f6dbfe0e92ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.138832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d31337-ddc7-4ba1-8626-f6dbfe0e92ba admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.148983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1254/2517] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:18.153567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.163398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7a2b5-3dca-44aa-9506-b2ab3b0fa08e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.168082 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.168720 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.169005 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.169284 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] PATH_INFO: `/v3/projects/591ecf33a0db4fc5b6b67780864dd3c5/users/00689cbbc6154fc9961ab314899c06a8/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.183936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591ecf33a0db4fc5b6b67780864dd3c5, user_id=00689cbbc6154fc9961ab314899c06a8, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.186558 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.200814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1264/2518] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:18 2022] PUT /identity/v3/projects/591ecf33a0db4fc5b6b67780864dd3c5/users/00689cbbc6154fc9961ab314899c06a8/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:18.211191 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26750a4-8da2-4f7a-93e5-85b6a17dfde2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.211484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26750a4-8da2-4f7a-93e5-85b6a17dfde2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.211761 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26750a4-8da2-4f7a-93e5-85b6a17dfde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.239451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b26750a4-8da2-4f7a-93e5-85b6a17dfde2 None None] MFA Rules not processed for user `00689cbbc6154fc9961ab314899c06a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:18.240734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b26750a4-8da2-4f7a-93e5-85b6a17dfde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:18.303425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1255/2519] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:18.308154 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.313610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:18.370036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22119786-f36a-41f3-b418-50752d696937 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.374632 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.375230 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.375514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.375814 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.376452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.378345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.404705 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1265/2520] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:18 2022] POST /identity/v3/projects => generated 357 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:18.408931 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26750a4-8da2-4f7a-93e5-85b6a17dfde2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.414410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:18.420879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26750a4-8da2-4f7a-93e5-85b6a17dfde2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.476546 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.477145 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.477427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.477715 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.478349 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.480318 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.500462 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1256/2521] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:18 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:18.504376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.515064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ad4c-f93e-4704-b079-21af7f7d5be6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.519992 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.520610 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.520910 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.521185 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.521816 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.523429 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.534792 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1266/2522] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:18.538720 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.548666 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a064-467c-4471-b87c-c31955ac5983 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.553228 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.553870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.554176 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.554447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] PATH_INFO: `/v3/projects/5122d99eee7f49a189aa17b11f3a4d1e/users/30f0427a6b204598a971f4ee1e76ada3/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.569576 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5122d99eee7f49a189aa17b11f3a4d1e, user_id=30f0427a6b204598a971f4ee1e76ada3, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.572846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.585306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1257/2523] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:18 2022] PUT /identity/v3/projects/5122d99eee7f49a189aa17b11f3a4d1e/users/30f0427a6b204598a971f4ee1e76ada3/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:18.589261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.599079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2872-c31b-4191-a1e7-acb77da54e32 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.654431 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5606628-8b16-4d6d-847b-a36b04463eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.655034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606628-8b16-4d6d-847b-a36b04463eea admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.655317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606628-8b16-4d6d-847b-a36b04463eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.655591 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606628-8b16-4d6d-847b-a36b04463eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.656267 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5606628-8b16-4d6d-847b-a36b04463eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.657855 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5606628-8b16-4d6d-847b-a36b04463eea admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.667310 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1267/2524] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:18.671457 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.682286 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d661fe-2d5d-4a2e-9d59-309f76956ce1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.686919 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.687562 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.687872 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.688149 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] PATH_INFO: `/v3/projects/5122d99eee7f49a189aa17b11f3a4d1e/users/30f0427a6b204598a971f4ee1e76ada3/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.690070 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5122d99eee7f49a189aa17b11f3a4d1e, user_id=30f0427a6b204598a971f4ee1e76ada3, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.692718 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.703293 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1258/2525] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:18 2022] PUT /identity/v3/projects/5122d99eee7f49a189aa17b11f3a4d1e/users/30f0427a6b204598a971f4ee1e76ada3/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:40:18.714424 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c588-ce4c-4020-99fe-db89095c800d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.714738 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c588-ce4c-4020-99fe-db89095c800d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.715015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c588-ce4c-4020-99fe-db89095c800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.742390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-42b0c588-ce4c-4020-99fe-db89095c800d None None] MFA Rules not processed for user `30f0427a6b204598a971f4ee1e76ada3`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:18.744121 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-42b0c588-ce4c-4020-99fe-db89095c800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:18.808621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:18.812529 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1268/2526] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:18.824322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.826123 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:18.882828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2b373-0552-44e3-85fd-4f5e576704c5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.886441 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.887045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.887323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.887598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:18.896550 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:18.898063 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:18.907427 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1259/2527] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:18.981658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c588-ce4c-4020-99fe-db89095c800d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:18.991143 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c588-ce4c-4020-99fe-db89095c800d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:18.995337 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a58a55-c4e8-4947-8d64-9c6b25323496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:18.995978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58a55-c4e8-4947-8d64-9c6b25323496 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:18.996286 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58a55-c4e8-4947-8d64-9c6b25323496 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:18.996559 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58a55-c4e8-4947-8d64-9c6b25323496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:19.051033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a58a55-c4e8-4947-8d64-9c6b25323496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:19.052427 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a58a55-c4e8-4947-8d64-9c6b25323496 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:19.061933 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1269/2528] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:28.903247 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:29.057776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=28 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:33.767877 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:33.830370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7884af-73ac-4e09-aee0-c4fe7f8ffeb2 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:33.834912 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:33.835529 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:33.835876 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:33.836111 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] PATH_INFO: `/v3/users/00689cbbc6154fc9961ab314899c06a8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:33.837216 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00689cbbc6154fc9961ab314899c06a8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:33.839738 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:33.884231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00689cbbc6154fc9961ab314899c06a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:33.884892 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00689cbbc6154fc9961ab314899c06a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:33.892009 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00689cbbc6154fc9961ab314899c06a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:33.892633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00689cbbc6154fc9961ab314899c06a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:33.905103 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00689cbbc6154fc9961ab314899c06a8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:33.917305 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1260/2529] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:33 2022] DELETE /identity/v3/users/00689cbbc6154fc9961ab314899c06a8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:33.921731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:33.922226 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:33.922350 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:33.941345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:33.942522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:33.998931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1270/2530] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:34.008507 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:34.009832 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:34.069131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1d3c-987d-46ca-8d45-11eab5969963 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:34.072777 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:34.073408 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:34.073685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:34.073954 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:34.082685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:34.084128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:34.093327 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1261/2531] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:34.352822 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:34.354847 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:34.366509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf43a14-69c9-4f5f-931a-e53c1ca88e55 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:34.371054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:34.371685 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:34.371991 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:34.372262 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] PATH_INFO: `/v3/projects/591ecf33a0db4fc5b6b67780864dd3c5` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:34.373372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591ecf33a0db4fc5b6b67780864dd3c5)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:34.375280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:34.422524 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591ecf33a0db4fc5b6b67780864dd3c5', 'request_id': 'req-b312878f-4b28-47bd-ba16-e8e3b563d197'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.428724 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591ecf33a0db4fc5b6b67780864dd3c5', 'request_id': 'req-b312878f-4b28-47bd-ba16-e8e3b563d197'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.436163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591ecf33a0db4fc5b6b67780864dd3c5', 'request_id': 'req-b312878f-4b28-47bd-ba16-e8e3b563d197'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.446586 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] The token cache is being invalidate because project 591ecf33a0db4fc5b6b67780864dd3c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:34.446877 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.447498 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.449016 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1271/2532] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:34 2022] DELETE /identity/v3/projects/591ecf33a0db4fc5b6b67780864dd3c5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:34.452966 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:34.462334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56a0f9-69a2-4cf4-8a26-6e41c0109856 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:34.480920 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:34.519752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:34.520395 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:34.520673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:34.520942 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] PATH_INFO: `/v3/users/30f0427a6b204598a971f4ee1e76ada3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:34.522038 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f0427a6b204598a971f4ee1e76ada3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:34.523963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:34.571292 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f0427a6b204598a971f4ee1e76ada3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.572023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f0427a6b204598a971f4ee1e76ada3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.579611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f0427a6b204598a971f4ee1e76ada3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.580264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f0427a6b204598a971f4ee1e76ada3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.592519 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a2696352-c9c2-44e6-a9a5-2402678e51b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f0427a6b204598a971f4ee1e76ada3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:34.604300 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1262/2533] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:34 2022] DELETE /identity/v3/users/30f0427a6b204598a971f4ee1e76ada3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:34.877131 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:34.878687 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:34.892830 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312878f-4b28-47bd-ba16-e8e3b563d197 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:34.957455 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:34.958160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:34.958406 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:34.958682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] PATH_INFO: `/v3/projects/5122d99eee7f49a189aa17b11f3a4d1e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:34.959825 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5122d99eee7f49a189aa17b11f3a4d1e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:34.961752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:34.991788 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:35.009802 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5122d99eee7f49a189aa17b11f3a4d1e', 'request_id': 'req-a8b330e4-22fc-47fb-81ae-f4c6199de28d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:35.017085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5122d99eee7f49a189aa17b11f3a4d1e', 'request_id': 'req-a8b330e4-22fc-47fb-81ae-f4c6199de28d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:35.024873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5122d99eee7f49a189aa17b11f3a4d1e', 'request_id': 'req-a8b330e4-22fc-47fb-81ae-f4c6199de28d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:35.035413 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] The token cache is being invalidate because project 5122d99eee7f49a189aa17b11f3a4d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:35.035706 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:35.036372 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a8b330e4-22fc-47fb-81ae-f4c6199de28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:35.037861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1272/2534] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:34 2022] DELETE /identity/v3/projects/5122d99eee7f49a189aa17b11f3a4d1e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:35.043696 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91888-a75b-48fe-9e77-f7b6fdcb6a6e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.044232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91888-a75b-48fe-9e77-f7b6fdcb6a6e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.044332 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91888-a75b-48fe-9e77-f7b6fdcb6a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.065104 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3dd91888-a75b-48fe-9e77-f7b6fdcb6a6e None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:35.066622 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3dd91888-a75b-48fe-9e77-f7b6fdcb6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:35.125085 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1263/2535] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:35.132908 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d87af-1bb3-47bb-be40-26762750b325 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.133201 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d87af-1bb3-47bb-be40-26762750b325 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.133480 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d87af-1bb3-47bb-be40-26762750b325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.153746 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e47d87af-1bb3-47bb-be40-26762750b325 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:35.154984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e47d87af-1bb3-47bb-be40-26762750b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:35.162860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1273/2536] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:35.167102 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd91888-a75b-48fe-9e77-f7b6fdcb6a6e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.177015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd91888-a75b-48fe-9e77-f7b6fdcb6a6e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.181788 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.182879 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.183155 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.183423 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.184093 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:40:35.184394 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.185974 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.197433 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1264/2537] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:40:35.202325 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d87af-1bb3-47bb-be40-26762750b325 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.211613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d87af-1bb3-47bb-be40-26762750b325 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.217214 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.217807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.218086 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.218355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.218984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.220902 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.248953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1274/2538] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:35.253054 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.263695 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aaa94-c335-4fcf-ad0d-6ca0f091f3c9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.289934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:35.322598 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.323693 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.324002 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.324277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.324914 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.326813 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.347277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1265/2539] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:35.351472 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.361726 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924a15-a0bd-4340-8744-1ae6e77f3f80 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.366203 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.366803 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.367085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.367359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.368029 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.369616 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.380040 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1275/2540] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:35.384052 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.394653 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e7cc6-4e46-4f05-a043-94f38beca7f6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.399326 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a2bb3-1405-4343-891d-e8c711ad7303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.399969 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2bb3-1405-4343-891d-e8c711ad7303 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.400261 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2bb3-1405-4343-891d-e8c711ad7303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.400534 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2bb3-1405-4343-891d-e8c711ad7303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.401705 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a2bb3-1405-4343-891d-e8c711ad7303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.403294 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a2bb3-1405-4343-891d-e8c711ad7303 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.414153 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1266/2541] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:35.418367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.428505 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b410909-7c3e-49a0-bc73-2f0e08215030 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.433420 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.434064 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.434407 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.434686 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] PATH_INFO: `/v3/projects/aaf00046575841fca7881a4b83aed5ed/users/47cceb277f5e484e83b55d4b6183fd3e/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.450865 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf00046575841fca7881a4b83aed5ed, user_id=47cceb277f5e484e83b55d4b6183fd3e, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.453553 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.466415 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1276/2542] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:35 2022] PUT /identity/v3/projects/aaf00046575841fca7881a4b83aed5ed/users/47cceb277f5e484e83b55d4b6183fd3e/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:35.477861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ffff-4ea8-4b7a-915e-acc41b21c204 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.478183 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ffff-4ea8-4b7a-915e-acc41b21c204 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.478415 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ffff-4ea8-4b7a-915e-acc41b21c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.506547 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1ff3ffff-4ea8-4b7a-915e-acc41b21c204 None None] MFA Rules not processed for user `47cceb277f5e484e83b55d4b6183fd3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:35.507767 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1ff3ffff-4ea8-4b7a-915e-acc41b21c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:35.571323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1267/2543] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:35.575921 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.635624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e529ac-ef42-4abd-9d14-4a9ce3737862 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.640164 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.640760 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.641036 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.641304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.641932 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.643859 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.670540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1277/2544] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:35.674545 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ffff-4ea8-4b7a-915e-acc41b21c204 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.685894 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ffff-4ea8-4b7a-915e-acc41b21c204 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.741698 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.742295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.742582 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.742853 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.743481 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.745444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.766208 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1268/2545] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:35.770328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.781280 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4243e46-89d4-4b0d-887d-1ee6c6de67a2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.785852 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.786449 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.786730 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.787003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.787640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.789279 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.800133 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1278/2546] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:35.804329 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.814646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e78d0-aafa-40bf-9752-e189fc77bff1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.819301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.819989 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.820275 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.820554 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] PATH_INFO: `/v3/projects/ee683ae175ec473190f3b3cb35d33c17/users/994cd2f6ceb94c10b5ec1e8ea28e684c/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.835045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee683ae175ec473190f3b3cb35d33c17, user_id=994cd2f6ceb94c10b5ec1e8ea28e684c, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.837724 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.850234 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1269/2547] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:35 2022] PUT /identity/v3/projects/ee683ae175ec473190f3b3cb35d33c17/users/994cd2f6ceb94c10b5ec1e8ea28e684c/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:35.854740 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.864509 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d176f-26dc-4041-a252-5882f9e51a37 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.883570 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:35.921966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac05e1-87d0-4bce-9e1a-2c0daadaabdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.922511 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac05e1-87d0-4bce-9e1a-2c0daadaabdd admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.922787 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac05e1-87d0-4bce-9e1a-2c0daadaabdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.923089 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac05e1-87d0-4bce-9e1a-2c0daadaabdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.923731 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac05e1-87d0-4bce-9e1a-2c0daadaabdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.925355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac05e1-87d0-4bce-9e1a-2c0daadaabdd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.935426 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1279/2548] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:35.939734 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:35.945185 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:35.951385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f51d8-e67d-44d0-a340-d3c37b0693ce admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:35.956301 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:35.956949 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.957230 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.957514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] PATH_INFO: `/v3/projects/ee683ae175ec473190f3b3cb35d33c17/users/994cd2f6ceb94c10b5ec1e8ea28e684c/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:35.959435 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee683ae175ec473190f3b3cb35d33c17, user_id=994cd2f6ceb94c10b5ec1e8ea28e684c, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:35.962092 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:35.972708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1270/2549] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:35 2022] PUT /identity/v3/projects/ee683ae175ec473190f3b3cb35d33c17/users/994cd2f6ceb94c10b5ec1e8ea28e684c/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:40:35.983458 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21402531-5363-4e22-8dff-e1397d3ad33c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:35.983959 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21402531-5363-4e22-8dff-e1397d3ad33c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:35.984084 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21402531-5363-4e22-8dff-e1397d3ad33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:36.010862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-21402531-5363-4e22-8dff-e1397d3ad33c None None] MFA Rules not processed for user `994cd2f6ceb94c10b5ec1e8ea28e684c`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:36.012091 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-21402531-5363-4e22-8dff-e1397d3ad33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:36.080383 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1280/2550] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:36.091708 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:36.093452 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:36.149129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cc325-8255-4529-8070-8531794d2016 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:36.153403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6c74b-f539-40d3-be0b-76d53735f950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:36.153998 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c74b-f539-40d3-be0b-76d53735f950 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:36.154278 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c74b-f539-40d3-be0b-76d53735f950 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:36.154553 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c74b-f539-40d3-be0b-76d53735f950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:36.163374 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6c74b-f539-40d3-be0b-76d53735f950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:36.164838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6c74b-f539-40d3-be0b-76d53735f950 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:36.174189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1271/2551] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:37.472683 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21402531-5363-4e22-8dff-e1397d3ad33c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:37.533301 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21402531-5363-4e22-8dff-e1397d3ad33c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:37.538031 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:37.538688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:37.538967 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:37.539235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] PATH_INFO: `/v3/users/47cceb277f5e484e83b55d4b6183fd3e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:37.540390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cceb277f5e484e83b55d4b6183fd3e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:37.542328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:37.587514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cceb277f5e484e83b55d4b6183fd3e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:37.588188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cceb277f5e484e83b55d4b6183fd3e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:37.589344 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:37.601522 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cceb277f5e484e83b55d4b6183fd3e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:37.602160 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cceb277f5e484e83b55d4b6183fd3e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:37.609801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cceb277f5e484e83b55d4b6183fd3e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:37.622624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1281/2552] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:37 2022] DELETE /identity/v3/users/47cceb277f5e484e83b55d4b6183fd3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:37.627081 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:37.627549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:37.627649 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:37.647609 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:37.648820 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:37.706425 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1272/2553] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:37.716547 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:37.717939 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:37.774500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31303c-00b5-4504-93c7-b936b4f237b0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:37.778191 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:37.778797 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:37.779079 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:37.779352 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:37.788408 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:37.789839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:37.799791 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1282/2554] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:38.057995 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:38.059417 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:38.071541 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647390f-895d-469b-9b12-4e8df5c3b68c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:38.076316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:38.076957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:38.077242 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:38.077514 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] PATH_INFO: `/v3/projects/aaf00046575841fca7881a4b83aed5ed` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:38.078634 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf00046575841fca7881a4b83aed5ed)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:38.080549 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:38.127198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf00046575841fca7881a4b83aed5ed', 'request_id': 'req-31078ba2-966d-4c40-bddd-6ad0ab96b38a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.134068 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf00046575841fca7881a4b83aed5ed', 'request_id': 'req-31078ba2-966d-4c40-bddd-6ad0ab96b38a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.139569 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf00046575841fca7881a4b83aed5ed', 'request_id': 'req-31078ba2-966d-4c40-bddd-6ad0ab96b38a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.150384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] The token cache is being invalidate because project aaf00046575841fca7881a4b83aed5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:38.150677 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.151861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.153335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1273/2555] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:38 2022] DELETE /identity/v3/projects/aaf00046575841fca7881a4b83aed5ed => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:38.157441 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:38.167741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25e3ba-ada1-40ab-8ec6-821bec03700f service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:38.222563 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:38.223182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:38.223464 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:38.223739 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] PATH_INFO: `/v3/users/994cd2f6ceb94c10b5ec1e8ea28e684c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:38.224885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=994cd2f6ceb94c10b5ec1e8ea28e684c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:38.226860 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:38.270576 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994cd2f6ceb94c10b5ec1e8ea28e684c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.271175 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994cd2f6ceb94c10b5ec1e8ea28e684c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.283312 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994cd2f6ceb94c10b5ec1e8ea28e684c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.283976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994cd2f6ceb94c10b5ec1e8ea28e684c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.287525 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:38.292935 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-938069de-7498-4bc3-b693-8bb17b5ede6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994cd2f6ceb94c10b5ec1e8ea28e684c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.306385 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1283/2556] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:38 2022] DELETE /identity/v3/users/994cd2f6ceb94c10b5ec1e8ea28e684c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:38.571685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:38.573827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:38.586790 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31078ba2-966d-4c40-bddd-6ad0ab96b38a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:38.599296 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:38.647005 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:38.647646 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:38.647946 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:38.648220 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] PATH_INFO: `/v3/projects/ee683ae175ec473190f3b3cb35d33c17` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:38.649323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee683ae175ec473190f3b3cb35d33c17)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:38.651859 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:38.697099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee683ae175ec473190f3b3cb35d33c17', 'request_id': 'req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.705167 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee683ae175ec473190f3b3cb35d33c17', 'request_id': 'req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.710840 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee683ae175ec473190f3b3cb35d33c17', 'request_id': 'req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.722069 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] The token cache is being invalidate because project ee683ae175ec473190f3b3cb35d33c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:38.722359 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.722985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2e1ebbf0-909b-4382-a2a9-6c185a20ae8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:38.724504 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1274/2557] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:38 2022] DELETE /identity/v3/projects/ee683ae175ec473190f3b3cb35d33c17 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:38.729304 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f797f7-491a-4188-9a47-f13aef4ac81b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:38.729765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f797f7-491a-4188-9a47-f13aef4ac81b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:38.729878 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f797f7-491a-4188-9a47-f13aef4ac81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:38.749306 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c8f797f7-491a-4188-9a47-f13aef4ac81b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:38.750483 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c8f797f7-491a-4188-9a47-f13aef4ac81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:38.809577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1284/2558] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:38.818298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f009e-275d-4e16-8c94-c36ea514970b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:38.818672 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f009e-275d-4e16-8c94-c36ea514970b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:38.819021 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f009e-275d-4e16-8c94-c36ea514970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:38.839049 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-067f009e-275d-4e16-8c94-c36ea514970b None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:38.840285 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-067f009e-275d-4e16-8c94-c36ea514970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:38.848267 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1275/2559] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:38.852379 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f797f7-491a-4188-9a47-f13aef4ac81b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:38.861898 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f797f7-491a-4188-9a47-f13aef4ac81b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:38.866409 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:38.866998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:38.867273 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:38.867542 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:38.868209 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:40:38.868508 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:38.870626 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:38.882055 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1285/2560] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:40:38.886850 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f009e-275d-4e16-8c94-c36ea514970b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:38.896170 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f009e-275d-4e16-8c94-c36ea514970b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:38.900793 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:38.901384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:38.901661 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:38.901934 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:38.902560 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:38.904490 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:38.931566 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1276/2561] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:38 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:40:38.936299 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:38.946334 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f986e-087f-4c64-abcd-cc0eb3cc0719 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.001376 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.001978 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.002264 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.002539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.003177 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.005182 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.026849 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1286/2562] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:38 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:40:39.030923 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.040990 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da652a9-2728-48b4-a507-733cadb4fc17 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.045511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.046095 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.046373 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.046641 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.047272 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.048893 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.059180 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1277/2563] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:39.062743 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.072541 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9d4a-2792-41ae-bc1d-f60e8918ad59 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.077670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c8b73-1428-4595-9e24-7a1fb86042a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.078251 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8b73-1428-4595-9e24-7a1fb86042a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.078531 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8b73-1428-4595-9e24-7a1fb86042a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.078804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8b73-1428-4595-9e24-7a1fb86042a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.079443 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c8b73-1428-4595-9e24-7a1fb86042a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.081069 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c8b73-1428-4595-9e24-7a1fb86042a2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.091309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1287/2564] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:39.095158 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.105475 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a6248-658c-4b0b-8bc6-30ca9b6c6812 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.110031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.110659 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.110936 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.111206 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] PATH_INFO: `/v3/projects/f73e86b416d14491a53178c165a0b793/users/2bf87ae30b7244a499e79ab46314a371/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.125971 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73e86b416d14491a53178c165a0b793, user_id=2bf87ae30b7244a499e79ab46314a371, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.128616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.141409 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1278/2565] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:39 2022] PUT /identity/v3/projects/f73e86b416d14491a53178c165a0b793/users/2bf87ae30b7244a499e79ab46314a371/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:39.202983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8d9b-00c9-40fd-b0e5-c4be95fd40f5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.203266 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8d9b-00c9-40fd-b0e5-c4be95fd40f5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.203539 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8d9b-00c9-40fd-b0e5-c4be95fd40f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.231428 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-05df8d9b-00c9-40fd-b0e5-c4be95fd40f5 None None] MFA Rules not processed for user `2bf87ae30b7244a499e79ab46314a371`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:39.232663 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-05df8d9b-00c9-40fd-b0e5-c4be95fd40f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:39.272857 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:39.296168 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1288/2566] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:39.300742 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.345080 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:39.363455 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df360da-80e6-4547-9833-3da67ec336a7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.368203 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.368839 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.369162 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.369447 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.370616 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.372678 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.397982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1279/2567] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:39 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:39.402072 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df8d9b-00c9-40fd-b0e5-c4be95fd40f5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.412676 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df8d9b-00c9-40fd-b0e5-c4be95fd40f5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.468359 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.468958 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.469239 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.469512 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.470141 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.472098 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.492990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1289/2568] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:39 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:39.496985 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.507048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa025e58-2033-4ae9-bc21-16b3e479c44e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.511573 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.512202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.512478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.512743 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.513372 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.515029 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.525565 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1280/2569] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:39.530317 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.540120 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1000d-2fa9-4347-8a77-8e2970d05227 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.545249 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.545885 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.546165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.546437 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] PATH_INFO: `/v3/projects/1803c405084a426f9224c1b2f7d1bc63/users/627989238cf3473d97d442efac4bd4e0/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.560906 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1803c405084a426f9224c1b2f7d1bc63, user_id=627989238cf3473d97d442efac4bd4e0, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.563514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.576083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1290/2570] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:39 2022] PUT /identity/v3/projects/1803c405084a426f9224c1b2f7d1bc63/users/627989238cf3473d97d442efac4bd4e0/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:39.580057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.590471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774aa1e-5820-413a-b300-bdf1abb623f8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.646306 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620a500-e55b-4094-b38b-703e00d003a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.646845 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a500-e55b-4094-b38b-703e00d003a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.647129 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a500-e55b-4094-b38b-703e00d003a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.647671 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a500-e55b-4094-b38b-703e00d003a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.648067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a500-e55b-4094-b38b-703e00d003a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.649654 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a500-e55b-4094-b38b-703e00d003a9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.660195 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1281/2571] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:40:39.664577 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.675399 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd38a-fc14-4551-9de9-cbb9ce4aca27 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.679966 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.680604 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.681138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.681411 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] PATH_INFO: `/v3/projects/1803c405084a426f9224c1b2f7d1bc63/users/627989238cf3473d97d442efac4bd4e0/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.683307 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1803c405084a426f9224c1b2f7d1bc63, user_id=627989238cf3473d97d442efac4bd4e0, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.685931 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.695947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1291/2572] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:39 2022] PUT /identity/v3/projects/1803c405084a426f9224c1b2f7d1bc63/users/627989238cf3473d97d442efac4bd4e0/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:39.705846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14097703-d548-45ff-8a6b-0a916f678f1a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.706133 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14097703-d548-45ff-8a6b-0a916f678f1a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.706405 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14097703-d548-45ff-8a6b-0a916f678f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.734633 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-14097703-d548-45ff-8a6b-0a916f678f1a None None] MFA Rules not processed for user `627989238cf3473d97d442efac4bd4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:39.735838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-14097703-d548-45ff-8a6b-0a916f678f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:39.809101 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1282/2573] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:39.820772 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.822506 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:39.879235 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152277-b066-4e46-8ea5-c0daf0bada22 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.883737 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.884366 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.884644 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.884917 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:39.894794 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:39.896398 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:39.907367 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1292/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:39.980664 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14097703-d548-45ff-8a6b-0a916f678f1a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:39.990313 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14097703-d548-45ff-8a6b-0a916f678f1a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:39.993957 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832f2cf-8f4b-4a3b-aafa-e71bb35f72b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:39.994579 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832f2cf-8f4b-4a3b-aafa-e71bb35f72b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:39.994863 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832f2cf-8f4b-4a3b-aafa-e71bb35f72b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:39.995202 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832f2cf-8f4b-4a3b-aafa-e71bb35f72b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:40.029031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:40.051978 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832f2cf-8f4b-4a3b-aafa-e71bb35f72b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:40.053411 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832f2cf-8f4b-4a3b-aafa-e71bb35f72b1 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:40.062494 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1283/2575] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:40.321564 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:40.360947 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:40.382453 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbbb60-a217-41cf-8530-25f028e5251d service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:40.387500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:40.388135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:40.388412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:40.388678 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] PATH_INFO: `/v3/users/2bf87ae30b7244a499e79ab46314a371` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:40.389771 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf87ae30b7244a499e79ab46314a371)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:40.391658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:40.436887 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf87ae30b7244a499e79ab46314a371'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:40.437478 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf87ae30b7244a499e79ab46314a371'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:40.449583 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf87ae30b7244a499e79ab46314a371'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:40.450212 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf87ae30b7244a499e79ab46314a371'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:40.456410 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf87ae30b7244a499e79ab46314a371'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:40.468289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1293/2576] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:40 2022] DELETE /identity/v3/users/2bf87ae30b7244a499e79ab46314a371 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:40.472846 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:40.473172 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:40.473444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:40.492258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:40.493459 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:40.550874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1284/2577] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:40.561256 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:40.562693 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:40.619011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d50a1-ecec-499b-8613-80fcd3e9b51f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:40.623328 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:40.623970 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:40.624255 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:40.624534 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:40.634015 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:40.635624 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:40.645100 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1294/2578] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:40.907658 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:40.909422 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:40.931410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5cd67-888c-4bc1-80d2-e643268d020d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:40.936703 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:40.937334 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:40.937614 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:40.937885 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] PATH_INFO: `/v3/projects/f73e86b416d14491a53178c165a0b793` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:40.938975 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73e86b416d14491a53178c165a0b793)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:40.940921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:40.987036 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73e86b416d14491a53178c165a0b793', 'request_id': 'req-e6aca829-59d4-40fb-98a9-a17649a5e6f3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:40.994034 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73e86b416d14491a53178c165a0b793', 'request_id': 'req-e6aca829-59d4-40fb-98a9-a17649a5e6f3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:40.999577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73e86b416d14491a53178c165a0b793', 'request_id': 'req-e6aca829-59d4-40fb-98a9-a17649a5e6f3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.010535 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] The token cache is being invalidate because project f73e86b416d14491a53178c165a0b793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:41.010827 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.011456 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.012950 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1285/2579] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:40 2022] DELETE /identity/v3/projects/f73e86b416d14491a53178c165a0b793 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:41.016957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.027135 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9d612-2b47-4fff-8dc9-a9489a0bf459 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.082721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.083345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.083621 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.083927 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] PATH_INFO: `/v3/users/627989238cf3473d97d442efac4bd4e0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.085033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627989238cf3473d97d442efac4bd4e0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.086930 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:41.088875 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:41.134165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627989238cf3473d97d442efac4bd4e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.134809 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627989238cf3473d97d442efac4bd4e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.146603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627989238cf3473d97d442efac4bd4e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.147231 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627989238cf3473d97d442efac4bd4e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.154736 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b52e0288-44bf-4e3d-b644-38ac38276211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627989238cf3473d97d442efac4bd4e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.167087 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1295/2580] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:41 2022] DELETE /identity/v3/users/627989238cf3473d97d442efac4bd4e0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:40:41.432804 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.434264 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:41.447236 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aca829-59d4-40fb-98a9-a17649a5e6f3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.503987 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.504648 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.504956 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.505237 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] PATH_INFO: `/v3/projects/1803c405084a426f9224c1b2f7d1bc63` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.506352 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1803c405084a426f9224c1b2f7d1bc63)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.508316 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:41.509755 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:41.556599 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1803c405084a426f9224c1b2f7d1bc63', 'request_id': 'req-bd5f963c-5560-4705-88bc-bb5de897c1c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.563451 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1803c405084a426f9224c1b2f7d1bc63', 'request_id': 'req-bd5f963c-5560-4705-88bc-bb5de897c1c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.568963 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1803c405084a426f9224c1b2f7d1bc63', 'request_id': 'req-bd5f963c-5560-4705-88bc-bb5de897c1c1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.580277 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] The token cache is being invalidate because project 1803c405084a426f9224c1b2f7d1bc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:41.580567 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.581252 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bd5f963c-5560-4705-88bc-bb5de897c1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:41.582711 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1286/2581] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:41 2022] DELETE /identity/v3/projects/1803c405084a426f9224c1b2f7d1bc63 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:40:41.588862 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b346-1a24-4341-a6de-bef92ce78b74 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.589149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b346-1a24-4341-a6de-bef92ce78b74 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.589422 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b346-1a24-4341-a6de-bef92ce78b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.608520 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8432b346-1a24-4341-a6de-bef92ce78b74 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:41.609708 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8432b346-1a24-4341-a6de-bef92ce78b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:41.668823 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1296/2582] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:41.677699 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8e65-766a-4d65-b3f2-974e50ae520a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.677982 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8e65-766a-4d65-b3f2-974e50ae520a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.678255 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8e65-766a-4d65-b3f2-974e50ae520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.699031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-df2e8e65-766a-4d65-b3f2-974e50ae520a None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:41.700321 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-df2e8e65-766a-4d65-b3f2-974e50ae520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:41.709376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1287/2583] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:41.713601 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b346-1a24-4341-a6de-bef92ce78b74 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.723521 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b346-1a24-4341-a6de-bef92ce78b74 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.728011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.728603 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.728889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.729165 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.729784 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:40:41.730083 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.731666 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:41.742988 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1297/2584] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:40:41.747873 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e8e65-766a-4d65-b3f2-974e50ae520a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.757108 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e8e65-766a-4d65-b3f2-974e50ae520a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.762636 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.763207 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.763510 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.763783 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.764445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.766323 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:41.792983 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1288/2585] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:41 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:40:41.797285 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.807782 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981818a-9b0a-4504-b68b-3af88ba87457 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.862801 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.863391 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.863669 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.863971 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.864600 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.866492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:41.877634 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:41.892556 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1298/2586] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:41 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:41.893733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.903779 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee6469-7014-4e92-a478-511a660d28f4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.908559 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.909164 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.909445 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.909717 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.910362 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.912032 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:41.921861 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1289/2587] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:41.925758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.936889 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76884297-d8ea-4cae-8ed1-aa55328fa936 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.941514 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a234a2e-3e43-4389-9dd3-2f8a41e908cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.942107 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234a2e-3e43-4389-9dd3-2f8a41e908cf admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.942387 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234a2e-3e43-4389-9dd3-2f8a41e908cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.942661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234a2e-3e43-4389-9dd3-2f8a41e908cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.943331 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a234a2e-3e43-4389-9dd3-2f8a41e908cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.944954 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a234a2e-3e43-4389-9dd3-2f8a41e908cf admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:41.955986 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1299/2588] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:41.959958 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:41.969655 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5737-7e63-41ca-bb50-be0e66a74a99 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:41.974219 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:41.974855 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:41.975135 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:41.975406 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] PATH_INFO: `/v3/projects/daec4e2f314a4a98a84f5077c75d0b16/users/2e9a57fcd01b489695a1e65975c945c7/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:41.989485 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daec4e2f314a4a98a84f5077c75d0b16, user_id=2e9a57fcd01b489695a1e65975c945c7, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:41.992131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.005265 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1290/2589] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:41 2022] PUT /identity/v3/projects/daec4e2f314a4a98a84f5077c75d0b16/users/2e9a57fcd01b489695a1e65975c945c7/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:42.016054 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceb507-5259-4707-957a-cb8d22b3883f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.016308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceb507-5259-4707-957a-cb8d22b3883f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.016584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceb507-5259-4707-957a-cb8d22b3883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.043780 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-79ceb507-5259-4707-957a-cb8d22b3883f None None] MFA Rules not processed for user `2e9a57fcd01b489695a1e65975c945c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:42.045051 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-79ceb507-5259-4707-957a-cb8d22b3883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:42.106981 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1300/2590] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:42.111400 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:42.171930 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a11753-d99d-4e5f-a2bc-d3b8dc5c9465 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:42.176511 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:42.177099 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.177382 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.177650 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.178274 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:42.180179 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.205757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1291/2591] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:42 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:42.209732 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceb507-5259-4707-957a-cb8d22b3883f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:42.220417 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceb507-5259-4707-957a-cb8d22b3883f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:42.275748 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:42.276315 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.276596 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.276869 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.277490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:42.279433 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.300548 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1301/2592] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:42 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:42.304540 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:42.315704 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b4b10-afec-41d0-9e63-69a1178fa298 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:42.320268 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:42.320838 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.321116 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.321385 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.322014 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:42.323874 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.329568 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:42.334900 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1292/2593] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:40:42.338945 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:42.348783 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da644682-6f7a-4a6f-a3ef-bab556cb3322 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:42.353345 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:42.354485 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.354765 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.355035 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] PATH_INFO: `/v3/projects/c3bf2574b47845bc836f8bb2e86138eb/users/dee590e9d3174ef1a2133362fa072b10/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.369948 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf2574b47845bc836f8bb2e86138eb, user_id=dee590e9d3174ef1a2133362fa072b10, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:42.372613 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.384846 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1302/2594] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:42 2022] PUT /identity/v3/projects/c3bf2574b47845bc836f8bb2e86138eb/users/dee590e9d3174ef1a2133362fa072b10/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:42.388673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:42.398320 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0498a-2588-4a03-b317-e401106fa291 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:42.455221 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e90d43-2b1b-4c61-9c27-60e367cc803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:42.455847 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90d43-2b1b-4c61-9c27-60e367cc803c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.456131 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90d43-2b1b-4c61-9c27-60e367cc803c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.456403 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90d43-2b1b-4c61-9c27-60e367cc803c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.457057 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e90d43-2b1b-4c61-9c27-60e367cc803c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:42.458640 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e90d43-2b1b-4c61-9c27-60e367cc803c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.468488 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1293/2595] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:42.472523 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:42.482976 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e579e4-1227-42c8-9d9a-a1fc602edaf9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:42.487764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:42.488438 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.488715 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.488984 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] PATH_INFO: `/v3/projects/c3bf2574b47845bc836f8bb2e86138eb/users/dee590e9d3174ef1a2133362fa072b10/roles/d3153f0d6f0840cea1f6440f44870b0d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.490871 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf2574b47845bc836f8bb2e86138eb, user_id=dee590e9d3174ef1a2133362fa072b10, role_id=d3153f0d6f0840cea1f6440f44870b0d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:42.493552 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.503854 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1303/2596] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:42 2022] PUT /identity/v3/projects/c3bf2574b47845bc836f8bb2e86138eb/users/dee590e9d3174ef1a2133362fa072b10/roles/d3153f0d6f0840cea1f6440f44870b0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:42.514757 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.515045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.515322 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.544266 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] MFA Rules not processed for user `dee590e9d3174ef1a2133362fa072b10`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:42.545388 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:42.610499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1294/2597] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:42.621058 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:42.622752 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:42.653839 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:42.681658 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf6c0-139d-4613-931d-05cc62517d9c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:42.685308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:42.685899 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:42.686180 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:42.686452 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:42.741866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:42.743291 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:42.752009 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1304/2598] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:46.944951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:46.946335 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:46.958376 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f722-8cbd-4a86-8ab9-ddcb98fa36d2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:46.961871 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37901bf-0ca7-4e21-bd59-37c881c19063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce79e1215c0345a59146c8bf6fe26cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:46.962458 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37901bf-0ca7-4e21-bd59-37c881c19063 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:46.962733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37901bf-0ca7-4e21-bd59-37c881c19063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:46.963000 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37901bf-0ca7-4e21-bd59-37c881c19063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:46.972141 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37901bf-0ca7-4e21-bd59-37c881c19063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:46.973544 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37901bf-0ca7-4e21-bd59-37c881c19063 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:46.983254 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1295/2599] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:40:52.019423 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:52.080530 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f14ce8-eeff-4d50-b667-dcb4537fa0af service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:52.085003 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:52.085617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:52.085897 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:52.086170 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] PATH_INFO: `/v3/users/2e9a57fcd01b489695a1e65975c945c7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:52.087261 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9a57fcd01b489695a1e65975c945c7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:52.089776 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:52.134707 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9a57fcd01b489695a1e65975c945c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.135896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9a57fcd01b489695a1e65975c945c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.147540 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9a57fcd01b489695a1e65975c945c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.148171 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9a57fcd01b489695a1e65975c945c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.155998 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9a57fcd01b489695a1e65975c945c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.164112 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:52.169188 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1305/2600] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:52 2022] DELETE /identity/v3/users/2e9a57fcd01b489695a1e65975c945c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:52.174006 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:52.174471 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:52.174577 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:52.194198 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:52.195384 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:52.252500 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1296/2601] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:52.262640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:52.264105 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:52.320288 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b5ff-5b97-4423-9979-a8981eee5022 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:52.324585 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:52.325184 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:52.325466 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:52.325741 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:52.334691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:52.336163 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:52.345457 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1306/2602] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:40:52.606479 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:52.607921 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:52.621182 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a7a5-f722-476a-bc0f-4f4e61c1b455 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:52.626186 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:52.626829 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:52.627136 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:52.627410 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] PATH_INFO: `/v3/projects/daec4e2f314a4a98a84f5077c75d0b16` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:52.629295 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daec4e2f314a4a98a84f5077c75d0b16)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:52.631232 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:52.634850 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:52.678611 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daec4e2f314a4a98a84f5077c75d0b16', 'request_id': 'req-b14628bc-ef42-4b27-9c3a-928fee9eafb1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.686741 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daec4e2f314a4a98a84f5077c75d0b16', 'request_id': 'req-b14628bc-ef42-4b27-9c3a-928fee9eafb1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.692259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daec4e2f314a4a98a84f5077c75d0b16', 'request_id': 'req-b14628bc-ef42-4b27-9c3a-928fee9eafb1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.703096 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] The token cache is being invalidate because project daec4e2f314a4a98a84f5077c75d0b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:52.703414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.704067 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.705615 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1297/2603] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:52 2022] DELETE /identity/v3/projects/daec4e2f314a4a98a84f5077c75d0b16 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:52.709630 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:52.719124 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1a9f-b675-445c-a31b-24ee3fa172cf service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:52.775289 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:52.775942 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:52.776220 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:52.776492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] PATH_INFO: `/v3/users/dee590e9d3174ef1a2133362fa072b10` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:52.777661 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee590e9d3174ef1a2133362fa072b10)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:52.779567 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:52.825187 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee590e9d3174ef1a2133362fa072b10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.825861 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee590e9d3174ef1a2133362fa072b10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.838179 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee590e9d3174ef1a2133362fa072b10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.838833 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee590e9d3174ef1a2133362fa072b10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.846183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-85cb7306-2e79-47a9-a815-62382a5a3a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee590e9d3174ef1a2133362fa072b10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:52.858896 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1307/2604] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:40:52 2022] DELETE /identity/v3/users/dee590e9d3174ef1a2133362fa072b10 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:53.119733 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.121347 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:53.134606 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14628bc-ef42-4b27-9c3a-928fee9eafb1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.191365 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.192037 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.192291 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.192564 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] PATH_INFO: `/v3/projects/c3bf2574b47845bc836f8bb2e86138eb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.193673 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bf2574b47845bc836f8bb2e86138eb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.195575 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.240968 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bf2574b47845bc836f8bb2e86138eb', 'request_id': 'req-c2259f41-5ff4-413e-850f-4ab0065e5dd7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:53.247955 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bf2574b47845bc836f8bb2e86138eb', 'request_id': 'req-c2259f41-5ff4-413e-850f-4ab0065e5dd7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:53.253536 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bf2574b47845bc836f8bb2e86138eb', 'request_id': 'req-c2259f41-5ff4-413e-850f-4ab0065e5dd7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:53.264414 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] The token cache is being invalidate because project c3bf2574b47845bc836f8bb2e86138eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:40:53.264726 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:53.265370 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c2259f41-5ff4-413e-850f-4ab0065e5dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:40:53.266819 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1298/2605] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:40:53 2022] DELETE /identity/v3/projects/c3bf2574b47845bc836f8bb2e86138eb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:53.272775 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cfc67-0f0b-4e49-a8cb-f8ae8822c894 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.273254 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cfc67-0f0b-4e49-a8cb-f8ae8822c894 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.273355 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cfc67-0f0b-4e49-a8cb-f8ae8822c894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.293615 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5c5cfc67-0f0b-4e49-a8cb-f8ae8822c894 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:53.294807 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c5cfc67-0f0b-4e49-a8cb-f8ae8822c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:53.311149 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:53.354617 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1308/2606] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:53.363053 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bae93-956b-4429-92ab-800ad0645904 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.363331 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bae93-956b-4429-92ab-800ad0645904 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.363608 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bae93-956b-4429-92ab-800ad0645904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.382771 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b06bae93-956b-4429-92ab-800ad0645904 None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:53.383972 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b06bae93-956b-4429-92ab-800ad0645904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:53.392402 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1299/2607] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:40:53.396445 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cfc67-0f0b-4e49-a8cb-f8ae8822c894 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.406560 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cfc67-0f0b-4e49-a8cb-f8ae8822c894 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.411097 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.411691 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.412205 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.412487 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.413138 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:40:53.413442 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.415033 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.426638 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1309/2608] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Oct 12 12:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:40:53.431387 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bae93-956b-4429-92ab-800ad0645904 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.440499 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bae93-956b-4429-92ab-800ad0645904 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.445122 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.445709 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.445986 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.446258 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.446878 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.449298 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.464478 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:53.478444 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1300/2609] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Oct 12 12:40:53 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:53.481891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.491953 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bfe9c-3995-4529-b5aa-e195ff9f8d0b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.547688 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.548326 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.548588 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.548858 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.549490 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.551388 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.572155 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1310/2610] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Oct 12 12:40:53 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:40:53.576765 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.586951 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47b7f-fa84-4d50-b424-4c7d771adf24 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.592157 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.592752 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.593035 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.593307 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.593948 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.595544 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.605175 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1301/2611] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:53.608956 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.618682 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d8f9f-ca73-42c2-8080-65a6ac2a5922 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.623199 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88776ba7-5d51-4f2f-9649-7497a4eedbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.623778 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776ba7-5d51-4f2f-9649-7497a4eedbbe admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.624085 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776ba7-5d51-4f2f-9649-7497a4eedbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.624353 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776ba7-5d51-4f2f-9649-7497a4eedbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.624983 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88776ba7-5d51-4f2f-9649-7497a4eedbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.626543 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88776ba7-5d51-4f2f-9649-7497a4eedbbe admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.637092 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1311/2612] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Oct 12 12:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:40:53.641031 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.651623 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0abd52-8cc3-48f5-a23c-feab0dfa4de1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.656269 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.656908 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.657189 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.657465 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] PATH_INFO: `/v3/projects/549881862b93493d8690acf33c781654/users/b76541ba8ba5475d8566fbdfd96c8920/roles/5b5518e8da0949ae9f1215f2739e508b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.671926 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=549881862b93493d8690acf33c781654, user_id=b76541ba8ba5475d8566fbdfd96c8920, role_id=5b5518e8da0949ae9f1215f2739e508b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.674563 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.687484 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1302/2613] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Oct 12 12:40:53 2022] PUT /identity/v3/projects/549881862b93493d8690acf33c781654/users/b76541ba8ba5475d8566fbdfd96c8920/roles/5b5518e8da0949ae9f1215f2739e508b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:40:53.699183 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7ad59-829a-4a8b-ad2a-7dd912e7a1da None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.699492 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7ad59-829a-4a8b-ad2a-7dd912e7a1da None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.699764 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7ad59-829a-4a8b-ad2a-7dd912e7a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.726518 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-58a7ad59-829a-4a8b-ad2a-7dd912e7a1da None None] MFA Rules not processed for user `b76541ba8ba5475d8566fbdfd96c8920`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:40:53.727700 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-58a7ad59-829a-4a8b-ad2a-7dd912e7a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:53.792641 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1312/2614] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:40:53.804450 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:40:53.806497 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:40:53.885048 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afd67d-25ac-466d-a3d2-433b5c95ce5d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:40:53.889231 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762f7fd-ce78-4e25-b662-bd5d1860c481 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fb6adedea24758bd852be1702cd1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:40:53.889828 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f7fd-ce78-4e25-b662-bd5d1860c481 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:40:53.890106 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f7fd-ce78-4e25-b662-bd5d1860c481 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:40:53.890375 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f7fd-ce78-4e25-b662-bd5d1860c481 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:40:53.898438 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762f7fd-ce78-4e25-b662-bd5d1860c481 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:40:53.899870 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762f7fd-ce78-4e25-b662-bd5d1860c481 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:40:53.908584 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1303/2615] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:40:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:03.789804 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:03.904714 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=2,keystone:SELECT=52 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:09.417582 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7ad59-829a-4a8b-ad2a-7dd912e7a1da None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:09.479873 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7ad59-829a-4a8b-ad2a-7dd912e7a1da None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:09.484414 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:09.485039 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:09.485321 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:09.485595 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] PATH_INFO: `/v3/users/b76541ba8ba5475d8566fbdfd96c8920` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:09.486704 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76541ba8ba5475d8566fbdfd96c8920)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:09.488670 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:09.533863 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76541ba8ba5475d8566fbdfd96c8920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.534503 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76541ba8ba5475d8566fbdfd96c8920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.545936 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76541ba8ba5475d8566fbdfd96c8920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.546671 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76541ba8ba5475d8566fbdfd96c8920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.553710 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76541ba8ba5475d8566fbdfd96c8920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.565721 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1313/2616] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:09 2022] DELETE /identity/v3/users/b76541ba8ba5475d8566fbdfd96c8920 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:09.570227 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:09.570685 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:09.570810 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:09.591818 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] MFA Rules not processed for user `733666fc411e4b24a7cb942e8e901594`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:09.593023 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:09.652072 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1304/2617] 10.222.0.45 () {58 vars in 958 bytes} [Wed Oct 12 12:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:09.661758 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:09.663308 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:09.719065 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40215f0b-016e-4d47-84b9-d7748351fd20 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:09.722664 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319b5538054c49d19ecc0b9c9cfc5b5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:09.723258 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:09.723536 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:09.723820 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:09.732475 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:09.733891 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:09.742990 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1314/2618] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:10.009348 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:10.011380 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:10.023082 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dff39b-61b8-4b6d-bf98-722717d0fe3f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:10.028482 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733666fc411e4b24a7cb942e8e901594', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f11c6a9324b4777879eb5cf98ff4596', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:10.029128 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:10.029413 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:10.029690 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] PATH_INFO: `/v3/projects/549881862b93493d8690acf33c781654` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:10.030997 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549881862b93493d8690acf33c781654)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:10.032941 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:10.080843 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549881862b93493d8690acf33c781654', 'request_id': 'req-582e5df2-00c4-4d6a-8925-42951cd4cc09'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.088259 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549881862b93493d8690acf33c781654', 'request_id': 'req-582e5df2-00c4-4d6a-8925-42951cd4cc09'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.094045 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549881862b93493d8690acf33c781654', 'request_id': 'req-582e5df2-00c4-4d6a-8925-42951cd4cc09'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.105094 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] The token cache is being invalidate because project 549881862b93493d8690acf33c781654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:10.105381 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.106015 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-582e5df2-00c4-4d6a-8925-42951cd4cc09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.107496 dv-cinder-812685-16-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1305/2619] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:10 2022] DELETE /identity/v3/projects/549881862b93493d8690acf33c781654 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:19.738957 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:20.102051 dv-cinder-812685-16-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:59.650011 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.651390 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.720500 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822eabd5-82ea-4e84-a452-5447853a5cb6 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.777412 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37a780-1677-4bbe-940d-18271fa543e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48cdf9ded77746a793b76d2df4940d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9643deeb10a4409bf8fc0de3692ba8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.778024 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37a780-1677-4bbe-940d-18271fa543e7 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.778309 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37a780-1677-4bbe-940d-18271fa543e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.778584 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37a780-1677-4bbe-940d-18271fa543e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.780828 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5d37a780-1677-4bbe-940d-18271fa543e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.792034 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37a780-1677-4bbe-940d-18271fa543e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.793640 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37a780-1677-4bbe-940d-18271fa543e7 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.804501 dv-cinder-812685-16-smb devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1315/2620] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:09.799866 dv-cinder-812685-16-smb devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=58 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}